A computer analysis of structures in image sequences methods and applications

Joatildeo Manuel R S Tavares

tavaresfeuppt wwwfeuppt~tavares

Mathematical Aspects of Imaging Modeling and Visualization in Multiscale BiologyMarch 31 ndash April 4 2009 The University of Texas at Austin USA

Outline

bull Presentationbull Introductionbull Tasks and Applications

ndash Segmentationndash Trackingndash Matching Registration and Morphingndash 3D Reconstruction

bull Research Projects amp PhD Thesisbull Scientific Events and Publicationsbull Research Teambull Conclusions and Future Work

Joatildeo Manuel R S Tavares 2A computer analysis of structures in image sequences methods and applications

Presentation

Presentation

bull Assistant Professor at Faculty of Engineering of University of Porto (FEUP) Department of Mechanical Engineering and Industrial Management

bull Senior Research and Projects Coordinator of the Optics and Experimental Mechanics Lab (LOME) of the Institute of Mechanical Engineering and Industrial Management (INEGI)

bull PhD and MSc degrees in Electrical and Computer Engineering from FEUP in 2001 and 1995 respectively

bull BSc degree in Mechanical Engineering from FEUP in 1992bull Research Areas Image Processing and Analysis Human-

Computer Interaction Product Development

Joatildeo Manuel R S Tavares 4A computer analysis of structures in image sequences methods and applications

FEUP Identity

bull With more than 80 years of history FEUP is the largest school of Universidade do Porto since 2000 FEUP has moved to a brand new campus just outside the city centre in eastern Porto Portugal

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 5

FEUP PORTO World heritage

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 6

FEUP Some Numbers

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 7

Coursesndash 3 undergraduate courses (1st Cycle) 2 of which are in cooperationndash 9 integrated master in engineering (1st + 2nd Cyles)ndash 8 MSc programmes (2nd Cycle)ndash 18 PhD programmes (3rd Cycle)

Academic communityndash full time teaching and research staff 432 FTE ndash 77 Doctoratendash administrative and technical staff 231 staff | 800 other contractsndash undergraduate students (1st + 2nd cycles) 5844ndash master and doctorate students 532 + 503

Scientific productionndash 11 ISI paper permanent staff yearndash 41 active or pending patents and brandsndash 18 spin-offs

INEGI Identity

bull The Institute of Mechanical Engineering and Industrial Management (INEGI) is an interface Institution between University and Industry founded in 1986

bull INEGI is oriented to activities of Research and Development (RampD) Innovation and Technology Transfer

bull INEGI has two RampD units financed and evaluated by the Fundaccedilatildeopara a Ciecircncia e a Tecnologia (FCT) the Experimental Mechanics and New Materials Unit (EXPMAT) and the New Technologies and Advanced Production Processes Unit (NOTEPAP)

bull The two research units that are part of the Associated Lab for Energy Transports and Aeronautics (LAETA) founded in 2006 and member of the Portuguese Council of the Associated Labs (CLA)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 8

INEGI Identity

bull The Experimental Mechanics and New Materials Unit (EXPMAT) is supported by a staff of more than 60 researchers (31 of which have a PhD degree)

bull EXPMAT is involved in partnership with more than 30 foreign companies universities and other research organizations in many research projects under European or more World-wide programs

bull Recently EXPMAT has been developing considerable research in Bioengineering Biomedical and Computational Vision fields

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 9

INEGI Identity

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 10

bull INEGI is located in the FEUP Campussince 2007

Introduction Computer Analysis of Structures in

Image Sequences

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Outline

bull Presentationbull Introductionbull Tasks and Applications

ndash Segmentationndash Trackingndash Matching Registration and Morphingndash 3D Reconstruction

bull Research Projects amp PhD Thesisbull Scientific Events and Publicationsbull Research Teambull Conclusions and Future Work

Joatildeo Manuel R S Tavares 2A computer analysis of structures in image sequences methods and applications

Presentation

Presentation

bull Assistant Professor at Faculty of Engineering of University of Porto (FEUP) Department of Mechanical Engineering and Industrial Management

bull Senior Research and Projects Coordinator of the Optics and Experimental Mechanics Lab (LOME) of the Institute of Mechanical Engineering and Industrial Management (INEGI)

bull PhD and MSc degrees in Electrical and Computer Engineering from FEUP in 2001 and 1995 respectively

bull BSc degree in Mechanical Engineering from FEUP in 1992bull Research Areas Image Processing and Analysis Human-

Computer Interaction Product Development

Joatildeo Manuel R S Tavares 4A computer analysis of structures in image sequences methods and applications

FEUP Identity

bull With more than 80 years of history FEUP is the largest school of Universidade do Porto since 2000 FEUP has moved to a brand new campus just outside the city centre in eastern Porto Portugal

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 5

FEUP PORTO World heritage

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 6

FEUP Some Numbers

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 7

Coursesndash 3 undergraduate courses (1st Cycle) 2 of which are in cooperationndash 9 integrated master in engineering (1st + 2nd Cyles)ndash 8 MSc programmes (2nd Cycle)ndash 18 PhD programmes (3rd Cycle)

Academic communityndash full time teaching and research staff 432 FTE ndash 77 Doctoratendash administrative and technical staff 231 staff | 800 other contractsndash undergraduate students (1st + 2nd cycles) 5844ndash master and doctorate students 532 + 503

Scientific productionndash 11 ISI paper permanent staff yearndash 41 active or pending patents and brandsndash 18 spin-offs

INEGI Identity

bull The Institute of Mechanical Engineering and Industrial Management (INEGI) is an interface Institution between University and Industry founded in 1986

bull INEGI is oriented to activities of Research and Development (RampD) Innovation and Technology Transfer

bull INEGI has two RampD units financed and evaluated by the Fundaccedilatildeopara a Ciecircncia e a Tecnologia (FCT) the Experimental Mechanics and New Materials Unit (EXPMAT) and the New Technologies and Advanced Production Processes Unit (NOTEPAP)

bull The two research units that are part of the Associated Lab for Energy Transports and Aeronautics (LAETA) founded in 2006 and member of the Portuguese Council of the Associated Labs (CLA)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 8

INEGI Identity

bull The Experimental Mechanics and New Materials Unit (EXPMAT) is supported by a staff of more than 60 researchers (31 of which have a PhD degree)

bull EXPMAT is involved in partnership with more than 30 foreign companies universities and other research organizations in many research projects under European or more World-wide programs

bull Recently EXPMAT has been developing considerable research in Bioengineering Biomedical and Computational Vision fields

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 9

INEGI Identity

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 10

bull INEGI is located in the FEUP Campussince 2007

Introduction Computer Analysis of Structures in

Image Sequences

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Presentation

Presentation

bull Assistant Professor at Faculty of Engineering of University of Porto (FEUP) Department of Mechanical Engineering and Industrial Management

bull Senior Research and Projects Coordinator of the Optics and Experimental Mechanics Lab (LOME) of the Institute of Mechanical Engineering and Industrial Management (INEGI)

bull PhD and MSc degrees in Electrical and Computer Engineering from FEUP in 2001 and 1995 respectively

bull BSc degree in Mechanical Engineering from FEUP in 1992bull Research Areas Image Processing and Analysis Human-

Computer Interaction Product Development

Joatildeo Manuel R S Tavares 4A computer analysis of structures in image sequences methods and applications

FEUP Identity

bull With more than 80 years of history FEUP is the largest school of Universidade do Porto since 2000 FEUP has moved to a brand new campus just outside the city centre in eastern Porto Portugal

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 5

FEUP PORTO World heritage

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 6

FEUP Some Numbers

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 7

Coursesndash 3 undergraduate courses (1st Cycle) 2 of which are in cooperationndash 9 integrated master in engineering (1st + 2nd Cyles)ndash 8 MSc programmes (2nd Cycle)ndash 18 PhD programmes (3rd Cycle)

Academic communityndash full time teaching and research staff 432 FTE ndash 77 Doctoratendash administrative and technical staff 231 staff | 800 other contractsndash undergraduate students (1st + 2nd cycles) 5844ndash master and doctorate students 532 + 503

Scientific productionndash 11 ISI paper permanent staff yearndash 41 active or pending patents and brandsndash 18 spin-offs

INEGI Identity

bull The Institute of Mechanical Engineering and Industrial Management (INEGI) is an interface Institution between University and Industry founded in 1986

bull INEGI is oriented to activities of Research and Development (RampD) Innovation and Technology Transfer

bull INEGI has two RampD units financed and evaluated by the Fundaccedilatildeopara a Ciecircncia e a Tecnologia (FCT) the Experimental Mechanics and New Materials Unit (EXPMAT) and the New Technologies and Advanced Production Processes Unit (NOTEPAP)

bull The two research units that are part of the Associated Lab for Energy Transports and Aeronautics (LAETA) founded in 2006 and member of the Portuguese Council of the Associated Labs (CLA)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 8

INEGI Identity

bull The Experimental Mechanics and New Materials Unit (EXPMAT) is supported by a staff of more than 60 researchers (31 of which have a PhD degree)

bull EXPMAT is involved in partnership with more than 30 foreign companies universities and other research organizations in many research projects under European or more World-wide programs

bull Recently EXPMAT has been developing considerable research in Bioengineering Biomedical and Computational Vision fields

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 9

INEGI Identity

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 10

bull INEGI is located in the FEUP Campussince 2007

Introduction Computer Analysis of Structures in

Image Sequences

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Presentation

bull Assistant Professor at Faculty of Engineering of University of Porto (FEUP) Department of Mechanical Engineering and Industrial Management

bull Senior Research and Projects Coordinator of the Optics and Experimental Mechanics Lab (LOME) of the Institute of Mechanical Engineering and Industrial Management (INEGI)

bull PhD and MSc degrees in Electrical and Computer Engineering from FEUP in 2001 and 1995 respectively

bull BSc degree in Mechanical Engineering from FEUP in 1992bull Research Areas Image Processing and Analysis Human-

Computer Interaction Product Development

Joatildeo Manuel R S Tavares 4A computer analysis of structures in image sequences methods and applications

FEUP Identity

bull With more than 80 years of history FEUP is the largest school of Universidade do Porto since 2000 FEUP has moved to a brand new campus just outside the city centre in eastern Porto Portugal

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 5

FEUP PORTO World heritage

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 6

FEUP Some Numbers

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 7

Coursesndash 3 undergraduate courses (1st Cycle) 2 of which are in cooperationndash 9 integrated master in engineering (1st + 2nd Cyles)ndash 8 MSc programmes (2nd Cycle)ndash 18 PhD programmes (3rd Cycle)

Academic communityndash full time teaching and research staff 432 FTE ndash 77 Doctoratendash administrative and technical staff 231 staff | 800 other contractsndash undergraduate students (1st + 2nd cycles) 5844ndash master and doctorate students 532 + 503

Scientific productionndash 11 ISI paper permanent staff yearndash 41 active or pending patents and brandsndash 18 spin-offs

INEGI Identity

bull The Institute of Mechanical Engineering and Industrial Management (INEGI) is an interface Institution between University and Industry founded in 1986

bull INEGI is oriented to activities of Research and Development (RampD) Innovation and Technology Transfer

bull INEGI has two RampD units financed and evaluated by the Fundaccedilatildeopara a Ciecircncia e a Tecnologia (FCT) the Experimental Mechanics and New Materials Unit (EXPMAT) and the New Technologies and Advanced Production Processes Unit (NOTEPAP)

bull The two research units that are part of the Associated Lab for Energy Transports and Aeronautics (LAETA) founded in 2006 and member of the Portuguese Council of the Associated Labs (CLA)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 8

INEGI Identity

bull The Experimental Mechanics and New Materials Unit (EXPMAT) is supported by a staff of more than 60 researchers (31 of which have a PhD degree)

bull EXPMAT is involved in partnership with more than 30 foreign companies universities and other research organizations in many research projects under European or more World-wide programs

bull Recently EXPMAT has been developing considerable research in Bioengineering Biomedical and Computational Vision fields

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 9

INEGI Identity

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 10

bull INEGI is located in the FEUP Campussince 2007

Introduction Computer Analysis of Structures in

Image Sequences

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

FEUP Identity

bull With more than 80 years of history FEUP is the largest school of Universidade do Porto since 2000 FEUP has moved to a brand new campus just outside the city centre in eastern Porto Portugal

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 5

FEUP PORTO World heritage

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 6

FEUP Some Numbers

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 7

Coursesndash 3 undergraduate courses (1st Cycle) 2 of which are in cooperationndash 9 integrated master in engineering (1st + 2nd Cyles)ndash 8 MSc programmes (2nd Cycle)ndash 18 PhD programmes (3rd Cycle)

Academic communityndash full time teaching and research staff 432 FTE ndash 77 Doctoratendash administrative and technical staff 231 staff | 800 other contractsndash undergraduate students (1st + 2nd cycles) 5844ndash master and doctorate students 532 + 503

Scientific productionndash 11 ISI paper permanent staff yearndash 41 active or pending patents and brandsndash 18 spin-offs

INEGI Identity

bull The Institute of Mechanical Engineering and Industrial Management (INEGI) is an interface Institution between University and Industry founded in 1986

bull INEGI is oriented to activities of Research and Development (RampD) Innovation and Technology Transfer

bull INEGI has two RampD units financed and evaluated by the Fundaccedilatildeopara a Ciecircncia e a Tecnologia (FCT) the Experimental Mechanics and New Materials Unit (EXPMAT) and the New Technologies and Advanced Production Processes Unit (NOTEPAP)

bull The two research units that are part of the Associated Lab for Energy Transports and Aeronautics (LAETA) founded in 2006 and member of the Portuguese Council of the Associated Labs (CLA)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 8

INEGI Identity

bull The Experimental Mechanics and New Materials Unit (EXPMAT) is supported by a staff of more than 60 researchers (31 of which have a PhD degree)

bull EXPMAT is involved in partnership with more than 30 foreign companies universities and other research organizations in many research projects under European or more World-wide programs

bull Recently EXPMAT has been developing considerable research in Bioengineering Biomedical and Computational Vision fields

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 9

INEGI Identity

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 10

bull INEGI is located in the FEUP Campussince 2007

Introduction Computer Analysis of Structures in

Image Sequences

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

FEUP PORTO World heritage

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 6

FEUP Some Numbers

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 7

Coursesndash 3 undergraduate courses (1st Cycle) 2 of which are in cooperationndash 9 integrated master in engineering (1st + 2nd Cyles)ndash 8 MSc programmes (2nd Cycle)ndash 18 PhD programmes (3rd Cycle)

Academic communityndash full time teaching and research staff 432 FTE ndash 77 Doctoratendash administrative and technical staff 231 staff | 800 other contractsndash undergraduate students (1st + 2nd cycles) 5844ndash master and doctorate students 532 + 503

Scientific productionndash 11 ISI paper permanent staff yearndash 41 active or pending patents and brandsndash 18 spin-offs

INEGI Identity

bull The Institute of Mechanical Engineering and Industrial Management (INEGI) is an interface Institution between University and Industry founded in 1986

bull INEGI is oriented to activities of Research and Development (RampD) Innovation and Technology Transfer

bull INEGI has two RampD units financed and evaluated by the Fundaccedilatildeopara a Ciecircncia e a Tecnologia (FCT) the Experimental Mechanics and New Materials Unit (EXPMAT) and the New Technologies and Advanced Production Processes Unit (NOTEPAP)

bull The two research units that are part of the Associated Lab for Energy Transports and Aeronautics (LAETA) founded in 2006 and member of the Portuguese Council of the Associated Labs (CLA)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 8

INEGI Identity

bull The Experimental Mechanics and New Materials Unit (EXPMAT) is supported by a staff of more than 60 researchers (31 of which have a PhD degree)

bull EXPMAT is involved in partnership with more than 30 foreign companies universities and other research organizations in many research projects under European or more World-wide programs

bull Recently EXPMAT has been developing considerable research in Bioengineering Biomedical and Computational Vision fields

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 9

INEGI Identity

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 10

bull INEGI is located in the FEUP Campussince 2007

Introduction Computer Analysis of Structures in

Image Sequences

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

FEUP Some Numbers

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 7

Coursesndash 3 undergraduate courses (1st Cycle) 2 of which are in cooperationndash 9 integrated master in engineering (1st + 2nd Cyles)ndash 8 MSc programmes (2nd Cycle)ndash 18 PhD programmes (3rd Cycle)

Academic communityndash full time teaching and research staff 432 FTE ndash 77 Doctoratendash administrative and technical staff 231 staff | 800 other contractsndash undergraduate students (1st + 2nd cycles) 5844ndash master and doctorate students 532 + 503

Scientific productionndash 11 ISI paper permanent staff yearndash 41 active or pending patents and brandsndash 18 spin-offs

INEGI Identity

bull The Institute of Mechanical Engineering and Industrial Management (INEGI) is an interface Institution between University and Industry founded in 1986

bull INEGI is oriented to activities of Research and Development (RampD) Innovation and Technology Transfer

bull INEGI has two RampD units financed and evaluated by the Fundaccedilatildeopara a Ciecircncia e a Tecnologia (FCT) the Experimental Mechanics and New Materials Unit (EXPMAT) and the New Technologies and Advanced Production Processes Unit (NOTEPAP)

bull The two research units that are part of the Associated Lab for Energy Transports and Aeronautics (LAETA) founded in 2006 and member of the Portuguese Council of the Associated Labs (CLA)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 8

INEGI Identity

bull The Experimental Mechanics and New Materials Unit (EXPMAT) is supported by a staff of more than 60 researchers (31 of which have a PhD degree)

bull EXPMAT is involved in partnership with more than 30 foreign companies universities and other research organizations in many research projects under European or more World-wide programs

bull Recently EXPMAT has been developing considerable research in Bioengineering Biomedical and Computational Vision fields

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 9

INEGI Identity

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 10

bull INEGI is located in the FEUP Campussince 2007

Introduction Computer Analysis of Structures in

Image Sequences

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

INEGI Identity

bull The Institute of Mechanical Engineering and Industrial Management (INEGI) is an interface Institution between University and Industry founded in 1986

bull INEGI is oriented to activities of Research and Development (RampD) Innovation and Technology Transfer

bull INEGI has two RampD units financed and evaluated by the Fundaccedilatildeopara a Ciecircncia e a Tecnologia (FCT) the Experimental Mechanics and New Materials Unit (EXPMAT) and the New Technologies and Advanced Production Processes Unit (NOTEPAP)

bull The two research units that are part of the Associated Lab for Energy Transports and Aeronautics (LAETA) founded in 2006 and member of the Portuguese Council of the Associated Labs (CLA)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 8

INEGI Identity

bull The Experimental Mechanics and New Materials Unit (EXPMAT) is supported by a staff of more than 60 researchers (31 of which have a PhD degree)

bull EXPMAT is involved in partnership with more than 30 foreign companies universities and other research organizations in many research projects under European or more World-wide programs

bull Recently EXPMAT has been developing considerable research in Bioengineering Biomedical and Computational Vision fields

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 9

INEGI Identity

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 10

bull INEGI is located in the FEUP Campussince 2007

Introduction Computer Analysis of Structures in

Image Sequences

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

INEGI Identity

bull The Experimental Mechanics and New Materials Unit (EXPMAT) is supported by a staff of more than 60 researchers (31 of which have a PhD degree)

bull EXPMAT is involved in partnership with more than 30 foreign companies universities and other research organizations in many research projects under European or more World-wide programs

bull Recently EXPMAT has been developing considerable research in Bioengineering Biomedical and Computational Vision fields

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 9

INEGI Identity

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 10

bull INEGI is located in the FEUP Campussince 2007

Introduction Computer Analysis of Structures in

Image Sequences

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

INEGI Identity

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 10

bull INEGI is located in the FEUP Campussince 2007

Introduction Computer Analysis of Structures in

Image Sequences

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Introduction Computer Analysis of Structures in

Image Sequences

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Computer Analysis of Structures in Image Sequences

bull The sensorial vision system has raised importance for numerous living organismsndash Making possible the processing of information of the most basic

sort as to check the existence of obstacles or of the most complex kind as the tracking and analysis of objects movement

ndash Common operations are identification of objects (segmentation) tracking of movement (tracking and analysis) objects matching and registration (matching and registration) reconstruction of 3D shapes from images (3D reconstruction)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 12

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull The researchers of the Computational Vision domain aim the development of computational algorithms to accomplish the operations and tasks performed by the (awfully complex) humanrsquos vision system in a full or semi-automatic manner

Joatildeo Manuel R S Tavares 13A computer analysis of structures in image sequences methods and applications 13

Original images

Azevedo et al (2007) 3D Volumetric Reconstruction and Characterization of Objects from Uncalibrated Images VIIP 2007 Spain 141-146

Computational 3D model built voxelized and

poligonized

Computer Analysis of Structures in Image Sequences

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Examples of common tasks involved in the computer analysis of structures in images are noise removal geometric correction data compression segmentation (2D3D) tracking and analysis of movement (2D3D) matching and registration (2D3D) and 3D reconstruction

bull Domains where algorithms of computer analysis of structures in images are frequently used Medicine Biology Industry Engineering Biomechanics Virtual Reality etc

Joatildeo Manuel R S Tavares 14A computer analysis of structures in image sequences methods and applications

Computer Analysis of Structures in Image Sequences

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Tasks and ApplicationsStructures Segmentation

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Segmentation

bull It is intended to identify in a full automatically or semi-automatically way the structures (2D3D) presented in an image or along image sequences

bull The most common methodologies used are based on statistical geometric or physical modeling

bull It is one of the most usual operations involved in the computer analysis of structures in images being frequently the first ldquoimportantrdquo considered task

bull Common problems noise low resolution reduced contrast shapes not previously known partial occlusions multiple structures presented etc

Joatildeo Manuel R S Tavares 16A computer analysis of structures in image sequences methods and applications

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Example contours segmentation in dynamicpedobarography (Otsu method)

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 17

Original images After segmentation

Bastos amp Tavares (2004) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Lecture Notes in Computer Science 317939-50

camera mirror

contact layer + glass

reflected light glass

pressure opaque layer

lamp

lamp transparent layer

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Segmentation

bull Example analysis of the damage in composite materials (binarization and region analysis)

Joatildeo Manuel R S Tavares 18A computer analysis of structures in image sequences methods and applications

Original image After segmentation

Damage areaobtained

Measures obtained

Marques et al (in press) Composites Science and Technology DOI 101016jcompscitech200901025

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Segmentation

bull Example analysis of materials microstructures (using neural networks)

Joatildeo Manuel R S Tavares 19A computer analysis of structures in image sequences methods and applications

Original images After segmentation

Albuquerque et al (2008) A New Solution for Automatic Microstructures Analysis fromImages Based on a Backpropagation Artificial Neural Network Nondestructive Testing and Evaluation 23(4)273-283

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Example control of a servomechanism bygestual language (orientation histograms)

Joatildeo Manuel R S Tavares 20A computer analysis of structures in image sequences methods and applications

Tavares et al (2005) Control a 2-Axis Servomechanism by Gesture Recognition usinga Generic WebCam International Journal of Advanced Robotic Systems 2(1)39-44

Running mode

Structures Segmentation

Conversion for 256 gray levels

Orders orientation histogram vectors

initialization (stored in memory)

1 2 3 4

Orders images acquisition (one by one)

Command image

acquisition Conversion for 256

gray levels

Comparison of the images orientation histogram vector

with the stored vectors of the preset orders images

Associated command

order

1 3 4

1 2 4

1 2 3

2 3 4

4

2

1

Learning mode

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Example detention of tumors in mammography images (Hough transform)

Joatildeo Manuel R S Tavares 21A computer analysis of structures in image sequences methods and applications

Chagas et al (2007) An Application of Hough Transform to Identify Breast Cancer in Images VIPimage 2007 Portugal 363-368

Original image After segmentation

Structures Segmentation

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Example image identification (image template matching)

Joatildeo Manuel R S Tavares 22A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

timesfft fft

ift

( )3ift D CC( )2ift D CC

max CC

Original imageTemplate image

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Example segmentation using deformablegeometric templates

Joatildeo Manuel R S Tavares 23A computer analysis of structures in image sequences methods and applications

Carvalho amp Tavares (2006) Two Methodologies for Iris Detection and Location in Face Images CompIMAGE 2006 Portugal 129-134Carvalho amp Tavares (2007) Eye detection using a deformable template in static images VipIMAGE 2007 Portugal 209-215

Original image and associated energy fields

Segmentation of the iris using adeformable template (a circle)

Segmentation of an eye using an deformable

template

Structures Segmentation

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Example segmentation of faces in images using statistical models for the skin

Joatildeo Manuel R S Tavares 24A computer analysis of structures in image sequences methods and applications

Samples used to build the statistical model Original image and

segmentation obtained

Carvalho amp Tavares (2005) Metodologias para identificaccedilatildeo de faces em imagens Introduccedilatildeo e exemplos de resultados CMNI 2005 Espantildea

Structures Segmentation

Probably function used

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 25

Background subtraction method

Foreground object detection method

bull Example backgroundforeground scene segmentation using statistical models

Vasconcelos amp Tavares (2008) Image Segmentation for Human Motion Analysis Methods and Applications WCCM8 ECCOMAS 2008 Italy

Structures Segmentation

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 26

Segmentation using Active Shape Models

Vasconcelos amp Tavares (2006) Methodologies to Build Automatic Point Distribution Models for Faces Represented in Images CompIMAGE 2006 Portugal 435-440

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Segmentation

bull Example segmentation using approaches based on point distributions models (Active Shape Models Active Appearance Models)

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 27

Vasconcelos amp Tavares (2008) Methods to Automatically Built Point Distribution Models for Objects like Hand Palms and Faces Represented in Images Computer Modeling in Engineering amp Sciences 36(3)213-241

Segmentation using an Active Appearance Model

Original image Resultant image

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Segmentation

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications 28

bull Example segmentation in the analysis of the vocal tract in speech production (Active Shape Models)

Vasconcelos et al (2009) Analysis of Tongue Shape and Motion in Speech Production using Statistical Modeling 2nd South-East European Conf on Computational Mechanics Greece

Image labeled Original shape Segmentation

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Example segmentation using deformable physical models (active contours - snakes)

Joatildeo Manuel R S Tavares 29A computer analysis of structures in image sequences methods and applications

Original image andinitial contour

Final contour

Tavares et al (in press) Computer Analysis of Objectsrsquo Movement in Image Sequences Methods and Applications International Journal for Computational Vision and Biomechanics

Structures Segmentation

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Example segmentation using deformable physical models (FEM Lagrange equation)

Joatildeo Manuel R S Tavares 30A computer analysis of structures in image sequences methods and applications

Original image and initial contour Final contourGonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Structures Segmentation

rubberk = 200Nm14s

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Example segmentation of medical images using level-sets methods

Joatildeo Manuel R S Tavares 31A computer analysis of structures in image sequences methods and applications

Original image Initial segmentation Final segmentation

Perdigatildeo et al (2005) Geraccedilatildeo de modelos de malhas de elementos finitos a partir de imagens meacutedicas 2D Encontro_1_Biomecacircnica Portugal 81-85

Structures Segmentation

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Example segmentation of medical images using a new computational framework (VC++ OpenCV ITK)

Joatildeo Manuel R S Tavares 32A computer analysis of structures in image sequences methods and applications

Interface of our platform

Ma et al (2008) Segmentation of Structures in Medical Images Review and a New Computational Framework CMBBE2008 Portugal

Structures Segmentation

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

bull Example segmentation of images of the pelvic cavity (using our platform)

Joatildeo Manuel R S Tavares 33A computer analysis of structures in image sequences methods and applications

Ma et al (in press) A Review of Algorithms for Medical Image Segmentation and their Applications to the Female Pelvic Cavity Computer Methods in Biomechanics and Biomedical Engineering

Structures Segmentation

Region Growing Watershed

Malladirsquos AlgorithmGeodesic Active Contour

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Tasks and ApplicationsStructures Tracking

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Tracking

bull It is intended to track the movement (andor the deformation) of structures along image sequences

bull In this area the methodologies based on block matching and stochastic methods are common

bull Usually it involves the estimation of the movement involved the management of the entities being tracked the analysis of the movement tracked as well as its quantification

bull Usual problems non-rigid movement geometric distortions non-constant illumination conditions occlusion noise multiple structures etc

Joatildeo Manuel R S Tavares 35A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Tracking

bull Example contours tracking in dynamic pedobarography(FEM Modal Analysis)

Joatildeo Manuel R S Tavares 36A computer analysis of structures in image sequences methods and applications

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Contours tracking

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Tracking

Joatildeo Manuel R S Tavares 37A computer analysis of structures in image sequences methods and applications

Prediction Uncertainty Area Measurement Correspondence Result

bull Example tracking in gait analysis (Kalman optimization)

Pinho et al (2005) Human Movement Tracking and Analysis with Kalman Filtering and Global Optimization Techniques ICCB 2005 Portugal 915-926

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Joatildeo Manuel R S Tavares A computer analysis of structures in image sequences methods and applications

Structures Tracking

bull Example tracking in gait analysis withdetention of events (Kalman optimization)

Sousa et al (2007) Registration between Data from Visual Sensors and Force Platform in Gait Event Detection ISHF2007 Portugal 331-340Sousa et al (2007) Selecting Biomechanical Variables for Detect Gait Events using Computational Vision ICCB 2007 Venuzuela 291-296

38

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Tracking

bull Example structures tracking along lengthy image sequences (Kalman optimization features management model)

Joatildeo Manuel R S Tavares 39A computer analysis of structures in image sequences methods and applications

Pinho et al (2007) Efficient Approximation of the Mahalanobis Distance for Tracking with the Kalman Filter International Journal of Simulation Modelling 6(2)84-92

(547 frames)

Pinho et al (2005) A Movement Tracking Management Model with Kalman Filtering Global Optimization Techniques and Mahalanobis Distance LSCCS Vol 4A463-466

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Tracking

bull Our actual goal Dynamical model(s) - Learning algorithm(s) to estimate the best models parameters

Joatildeo Manuel R S Tavares 40A computer analysis of structures in image sequences methods and applications

Several objects = One dynamical model

Large image sequences = One dynamical model

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Tasks and ApplicationsStructures Matching

Registration and Morphing

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 42A computer analysis of structures in image sequences methods and applications

bull Matchingndash It is regularly used in the computer analysis of structures in

images for example to register (align) structures in images recognize structures obtain 3D information analyze the movement tracked etc

ndash Generally it is accomplished through the consideration of characteristic invariants as the curvature or the displacements in global spaces as the modal space

ndash Common problems occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 43A computer analysis of structures in image sequences methods and applications

bull Registrationndash It is commonly required to compare structures represented in

images acquired in different time instants or according distinct conditions

ndash It is essential for example in Medicine to follow up the evaluation of patientsrsquo diseases from images

ndash Generally it is accomplished through the consideration of structures characteristic features as maximum curvature points their matching and the estimation of the involved transformation

ndash Common problems key and invariant features not easily identified occlusion non-rigid deformations high shapes variations etc

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Matching Registration and Morphing

Joatildeo Manuel R S Tavares 44A computer analysis of structures in image sequences methods and applications

bull Morphing (simulation)ndash It is a very used task in Computer Graphics but also very useful in

the analysis of structures in images for example to estimate the deformation involved between two distinct structures or between two configurations of one structure to estimate the transitions between two shapes acquired with high temporal gap etc

ndash Generally it is accomplished through the consideration of geometric transformations

ndash However when it must be considered the physical behavior of the involved structures physical methodologies and modeling as for example FEM should be employed

bull Common difficulties are related with the estimation of the involved forces and with the properties of the adopted (virtual) material

bull The adequate matching of the structures involved becomes crucial

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Joatildeo Manuel R S Tavares 45A computer analysis of structures in image sequences methods and applications

Image of dynamic pedobarography

Initial contour Final contour

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Matching found

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Joatildeo Manuel R S Tavares 46A computer analysis of structures in image sequences methods and applications

Matchings found betweeniso-contours

Matchings found betweensurfaces

Structures Matching

bull Example matching contours and surfaces in dynamic pedobarography (FEM Modal Analysis optimization)

Tavares amp Bastos (2005) Improvement of Modal Matching Image Objects in Dynamic Pedobarography using Optimization Techniques Electronic Letters on Computer Vision and Image Analysis 5(3)1-20

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Joatildeo Manuel R S Tavares 47A computer analysis of structures in image sequences methods and applications

Structures Matching

bull Example matching contours with order restriction (geometrical modeling optimization dynamic programming)

Oliveira amp Tavares (2008) Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points Computer Modeling in Engineering amp Sciences 31(1)1-11

Original images and contoursMatching found without

order restrictionMatching found with order

restriction

Bastos amp Tavares (2006) Matching of Objects Nodal Points Improvement using Optimization Inverse Problems in Science and Engineering 14(5)529-541

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Joatildeo Manuel R S Tavares 48A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Estimated deformations

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Contours matched

Estimateddeformations

Tavares amp Pinho (2005) Estimaccedilatildeo Temporal da Deformaccedilatildeo entre Objectos utilizando uma Metodologia Fiacutesica InfoComp 4(1)9-18

Original images

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Joatildeo Manuel R S Tavares 49A computer analysis of structures in image sequences methods and applications

Structures Morphing

bull Example morphing contours (FEM Modal Analysis optimization)

Matching found Deformations estimated

Gonccedilalves et al (2008) Segmentation and Simulation of Objects Represented in Images using Physical Principles Computer Modeling in Engineering amp Sciences 32(1)45-55

Original images

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Joatildeo Manuel R S Tavares 50A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of contours in images (geometrical modeling optimization dynamic programming)

Original images and contours found

Matched contours before registration

Matched contours after registration

Oliveira amp Tavares (in press) Matching Contours in Images using Curvature and Distance to Centroid Information and Dynamic Programming Computer Modeling in Engineering amp Sciences

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Joatildeo Manuel R S Tavares 51A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found Contours and images

before registrationContours and images

after registration

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Joatildeo Manuel R S Tavares 52A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of images in dynamic pedobarography (geometrical modeling optimization dynamic programming)

Original images and contours found

Contours matched before registration

Images after registration

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Joatildeo Manuel R S Tavares 53A computer analysis of structures in image sequences methods and applications

Structures Registration

bull Example registration of brain imagesin the diagnosis of multiple sclerosislesions

Source image Target image

After rotation

After scale

After translation

Jacob et al (2009) Algoritmos para Alinhamento de Imagens Meacutedicas Princiacutepios e Aplicaccedilatildeo em Imagens de Esclerose Muacuteltipla 3ordm Congresso Nacional de Biomecacircnica Portugal 549-556

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Tasks and ApplicationsStructures 3D Reconstruction

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures 3D Reconstruction

bull It is intended to accomplish the 3D reconstruction of structures from images

bull In this area the following methodologies are common external shapes ndash active techniques (with energy projection or relative movement) passive techniques (without energy projection or relative movement) and of space carving interior shapes ndash 2Dsegmentation (contours for example) and interpolation

bull Usually it involves tasks of camera calibration data segmentation matching triangulation and interpolation

bull Common problems geometric distortion bad or varying illumination conditions occlusion noise multiple structures complex shapes etc

Joatildeo Manuel R S Tavares 55A computer analysis of structures in image sequences methods and applications

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures 3D Reconstruction

bull Example 3D reconstruction of organs from medical images

Joatildeo Manuel R S Tavares 56Anaacutelise de Estruturas em Imagens Segmentaccedilatildeo Seguimento e Reconstruccedilatildeo 3D

Segmentation done in a slice and 3D reconstruction obtained

3D reconstruction of some structures of the arm

Perdigatildeo et al (2005) Sobre a Geraccedilatildeo de Malhas Tridimensionais para fins Computacionais a partir de Imagens Meacutedicas CMNI 2005 Espantildea

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 57A computer analysis of structures in image sequences methods and applications

Segmentation donein a slice

Pelvic floor reconstructed Reconstructed structures of the pelvic cavity

Pimenta et al (2006) Reconstruction of 3D Models from Medical Images Application to Female Pelvic Organs CompIMAGE 2006 Coimbra Portugal 343-348Alexandre et al (2007) 3D reconstruction of pelvic floor for numerical simulation purpose VipIMAGE 2007 Porto Portugal 359-362

bull Example 3D reconstruction of organs from medical images

slices

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures 3D Reconstruction

bull Example 3D reconstruction using techniques of active vision

Joatildeo Manuel R S Tavares 58A computer analysis of structures in image sequences methods and applications

Disparity mapobtained

Original image pair

Azevedo et al (2006) Development of a Computer Platform for Object 3D Reconstruction using Active Vision Techniques VISAPP 2006 Portugal 383-388

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures 3D Reconstruction

bull Example 3D reconstruction using space carving

Joatildeo Manuel R S Tavares 59A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Structures 3D Reconstruction

Joatildeo Manuel R S Tavares 60A computer analysis of structures in image sequences methods and applications

Azevedo et al (2008) 3D Object Reconstruction from Uncalibrated Images using an Off-the-Shelf Camera Advances in Computational Vision and Medical Image Processing Methods and Applications 117-136

Original images Computational 3D model built voxelized and poligonized

bull Example 3D reconstruction using space carving

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Human Perception andData Visualization

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Human Perception and Data Visualization

bull Recently some projects involving the visualization and analysis of complex large and crucial data have been developed based on principles of human perceptionndash visualization and analysis of huge volumes of datandash visualization and analysis of temporal critical data

Joatildeo Manuel R S Tavares 62A computer analysis of structures in image sequences methods and applications

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Human Perception and Data Visualization

bull Example visualization and analysis of huge volumes of computational data

Joatildeo Manuel R S Tavares 63A computer analysis of structures in image sequences methods and applications

Gonccedilalves amp Tavares (2008) A GUI for a Software that Analyses a Composite Bolted Joint e-Minds International Journal on Human-Computer Interaction I(4)25-41

Computational interface developed to visualize and analyze the data of a composite bolted joint simulator

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Human Perception and Data Visualization

bull Example visualization and analysis of critical data in air traffic control (ATC)

Joatildeo Manuel R S Tavares 64A computer analysis of structures in image sequences methods and applications

Sousa amp Tavares (submitted) ATCBlur an Air Traffic Control display filtering tool International Journal of Human-Computer Studies

Computational interface developed to analyze and evaluate the use of visualization filters based on human perception in tasks of visual searching in ATC displays

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects ampPhD Thesis

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull In the last years we have been involved in some national and international research projects as research team members as well as project coordinators

bull Currently we have several PhD thesis undergoing considering important topics of image processing and analysis

Joatildeo Manuel R S Tavares 66A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Biomechanical study of the middle ear for auditory

rehabilitationCoordinator Renato M Natal Jorge FEUPInstitution IDMEC - Polo FEUPFinancing Institution FCT 5000000 euroDuration 36 months started in July 2007

ndash BIOPELVIC - Study of Female Pelvic Floor DisordersCoordinator Renato M Natal Jorge FEUPInstitutions IDMEC - Polo FEUP FMUP INESC-PortoFinancing Institution FCT 19881600 euroDuration 36 months started in July 2007

Joatildeo Manuel R S Tavares 67A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Rede Luso-Brasileiro de Bioengenharia

Coordinator Renato M Natal Jorge FEUPFinancing Institution GRICESCAPES 2007Duration 36 months started in January 2007

ndash Aberrant Crypt Foci and Human Colorectal Polyps mathematical modelling and endoscopic image processingCoordinator Isabel Figueiredo FCTUC-PTInstitutions FCTUC-PT FEUP-PT FMUC-PT IT-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 48 months started in April 2009 ()

Joatildeo Manuel R S Tavares 68A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull Research Projects (in course)ndash Cardiovascular Imaging Modeling and Simulation - SIMCARD

Coordinator Adeacutelia Sequeira IST-PTInstitutions IST-PT FEUP-PT HSM-PT SPRM-PT UTA-USAFinancing Program UT Austin|Portugal 2008Duration 24 months started in April 2009 ()

Joatildeo Manuel R S Tavares 69A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash BioSpine ndash Development of External Biocompatible

ProsthesisVestsCoordinator Manuel Laranjeira Gomes ICBASInstitutions INEGI INEB ICBASFinancing Institution ADI 10000000 euroDuration 24 months started in January 2007

ndash ACTIDEF ndash Integrated Computational and Technological Evaluation of the Performance and Functionality of Citizens with Muscular IncapacitiesCoordinator Jeroacutenimo de Sousa CRPGInstitutions CRPG INEB INEGIFinancing Program POS_C 15000000 euroDuration 12 months started in February 2006

Joatildeo Manuel R S Tavares 70A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull Research Projects (finished)ndash Segmentation Tracking and Motion Analysis of Deformable

(2D3D) Objects using Physical PrinciplesCoordinator Joatildeo Manuel R S TavaresParticipant Institutions INEGI INEBFinancing Institution FCT 6342000 euroDuration 36 months started in May 2005

Joatildeo Manuel R S Tavares 71A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Analysis of Movement using Computational Vision

Student Raquel R PinhoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since April 2003

ndash Application of Physical Principles in the Analysis of Objects Represented in ImagesStudent Patriacutecia C T GonccedilalvesSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since February 2006

Joatildeo Manuel R S Tavares 72A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Modeling for the Analysis of the Mechanical

Behavior of Structures represented in Image Sequences Applications in Medical ImagesStudent Ilda M de Saacute ReisSupervisor Joatildeo Manuel R S TavaresCo-supervisors R M Natal Jorge FEUP A F Leite-Moreira FMUPPhD in Engineering Sciences University of Porto since March 2007

ndash Unsupervised Geometrical Modelling of the Scoliotic Spine from RadiographsStudent Daniel C de MouraSupervisor Jorge G Barbosa FEUPCo-supervisor Joatildeo Manuel R S TavaresDoctoral Program in Informatics University of Porto since September 2006

Joatildeo Manuel R S Tavares 73A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Modeling the Shape and Motion of Objects in Image Sequences

Applications in Biomechanics of the Human BodyStudent Maria J M de Vasconcelos Supervisor Joatildeo Manuel R S TavaresCo-supervisor Miguel V Correia FEUPPhD in Engineering Sciences University of Porto since July 2007

ndash Reconstruction of 3D Objects Shape using Computational Vision Applications in the Reconstruction and Characterization of External Anatomical StructuresStudent Teresa C S AzevedoSupervisor Joatildeo Manuel R S TavaresCo-supervisor Maacuterio A P Vaz FEUPPhD in Engineering Sciences University of Porto since October 2006

Joatildeo Manuel R S Tavares 74A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Computational Methodologies for Three-Dimensional

Reconstruction and Recognition of Shape and Motion Patterns in the Analysis of Dynamic Fluid Flow in Automotive Conditional Air SystemsStudent Elza M P F ChagasSupervisor Denilson L Rodrigues PCU-MG ndash BrazilCo-supervisor Joatildeo Manuel R S TavaresPhD Thesis in Mechanical Engineering PCU-MG ndash Brazil since January 2007

Joatildeo Manuel R S Tavares 75A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Image Processing and Analysis in the Characterization of Parts

and OperationsStudent Victor H C de AlbuquerqueSupervisor Joatildeo Manuel R S TavaresCo-supervisor Luiacutes M P Duratildeo ISEPPhD in Engineering Sciences University of Porto since July 2007

ndash Segmentation Tracking and 3D Reconstruction of Structures Represented in Images Applications in Medical ImagesStudent Zhen MaSupervisor Joatildeo Manuel R S TavaresCo-supervisor R M Natal Jorge FEUPPhD in Engineering Sciences University of Porto since July 2007

Joatildeo Manuel R S Tavares 76A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Matching and Registration of Structures in Computational

Vision Applications in Medical ImagesStudent Francisco P M de OliveiraSupervisor Joatildeo Manuel R S TavaresCo-supervisor Durval C Costa HPP-Medicina Molecular SADoctoral Program in Biomedical Engineering University of Porto since 20082009

ndash Neuronal Quantitative Evaluation in Tensor Diffusion ImagesStudent Eduardo F C RibeiroSupervisor Joatildeo Manuel R S TavaresCo-supervisors A M Reis PHH Chandrajit Bajaj UTADoctoral Program in Biomedical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 77A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Research Projects amp PhD Thesis

bull PhD Thesis (in course)ndash Methodologies and Active Systems based on Sensorial Fusion

for Movement Analysis ndash Applications in BiomechanicsStudent Antoacutenio F N GomesSupervisor Joatildeo Manuel R S TavaresCo-supervisor Joaquim G Mendes FEUPDoctoral Program in Mechanical Engineering University of Porto since 20082009

Joatildeo Manuel R S Tavares 78A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Scientific Events amp Publications

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Scientific Events amp Publications

bull In the last years we have been involved in the organization of several scientific eventsndash mini-symposia workshops and conferences

bull and in the editing of several scientific publicationsndash conferences proceedings books special issue of journals and the

editing of scientific journals

Joatildeo Manuel R S Tavares 80A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 81A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair National Meeting on Scientific VisualizationPortugal 17 September 2005

Co-chair CompIMAGE - Computational Modelling of Objects Represented in Images Fundamentals Methods and ApplicationsPortugal 20-21 October 2006

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 82A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Thematic session ldquoImage processing Visualization and InterfacesrdquoMeacutetodos Numeacutericos em Engenharia (CMNE) amp XXVIII CILAMCE - Congresso IberoLatino-Americano sobre Meacutetodos Computacionais em EngenhariaPortugal 13-15 June 2007

Co-chair VIPimage 2007 - I ECCOMAS Thematic Conference on Computational Vision and Medical Image ProcessingPortugal 17-19 October 2007

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 83A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Mini-Symposium ldquoComputational Methods in Image AnalysisrdquoThe ninth US National Congress on Computational Mechanics (USNCCM IX)USA 22-26 July 2007

Mini-symposium ldquoComputational Bioimaging and VisualizationrdquoVIII World Conference on Computational Mechanics (WCCM VIII) amp V European Congress on Computational Methods in Applied Science and Engineering (ECCOMAS V)Italy 30 June - 5 July 2008

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 84A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair Workshop Applications of a Movement Analysis LabPortugal 23 March 2007

Mini-Symposium ldquoImage Processing and AnalysisrdquoICCES08 - International Conference on Computational and Experimental Engineering amp SciencesHawaii 17-22 March 2008

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 85A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Mini-Symposium ldquoImage Processing and Visualizationrdquo5ordm Congresso Luso-Moccedilambicano de EngenhariaMozambique 2-4 September 2008

Workshop ldquoMedical Imaging SystemsrdquoEUROMEDIA 2008 - The Multimedia Applications ConferencePortugal 9-11 April 2008

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 86A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair EUROMEDIA 2008 - The Multimedia Applications ConferencePortugal 9-11 April 2008

International Workshop on Combinatorial Image Analysis (IWCIA08)USA 7-9 April 2008

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 87A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Mini-Symposium ldquoBiomechanical Behavior of Soft TissuesrdquoMini-Symposium ldquoComputational Methods in Image Processing for BiomechanicsrdquoCMBBE2008 - 8th International Symposium on Computer Methods in Biomechanics and Biomedical EngineeringPortugal 27 February - 1 March 2008

Special Track ldquoComputational Bioimaging and VisualizationrdquoISVC08 - 4th International Symposium on Visual ComputingUSA 1-3 December 2008

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 88A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair 1st International Conference on Imaging Theory and Applications (IMAGAPP)Portugal 5-8 February 2009

Mini-Symposium ldquoImage Processing and AnalysisrdquoICCES09 - Int Conference on Computational and Experimental Engineering amp SciencesThailand 8-13 April 2009

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 89A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Mini-Symposium ldquoImage Processing and Data VisualizationrdquoSEECCM 2009 - 2nd South-East European Conference on Computational MechanicsGreece 22-24 June 2009

Thematic Session ldquoImage Processing Visualization and InterfacesrdquoCongreso de Meacutetodos Numeacutericos en Ingenieriacutea 2009Spain 29 June - 2 July 2009

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 90A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Mini-Symposium ldquoComputational Methods in Image Analysisrdquo10th US National Congress of Computational MechanicsUSA 16-19 July 2009

Mini-Symposium ldquoImage Processing and Visualization in Solid Mechanics Processesrdquo7th EUROMECH Solid Mechanics Conference ndash ESMC2009Portugal 7-11 September 2009

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 91A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Workshop ldquoMedical Imaging SystemsrdquoEUROMEDIA 2009 - The Multimedia Applications ConferenceBelgium 15-17 April 2009

Mini-Symposium ldquoVisualization and Human-Computer InteractionrdquoIRFrsquo2009 ndash Integrity - Reliability - Failure Challenges and OpportunitiesPortugal 20-24 July 2009

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 92A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair I International Conference on Biodental EnginneringPortugal 26-27 June 2009

Co-chair 6th International Conference on Technology and Medical SciencesPortugal 21-22 October 2010

Events amp Publications

bull Conferences Symposia and Workshops

Joatildeo Manuel R S Tavares 93A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-chair VIPimage 2009 - II ECCOMAS Thematic Conference on Computational Vision and Medical Image ProcessingPortugal 14-16 October 2009

Co-chair CompIMAGE2010 Symposium - Computational Modeling of Objects Represented in Images Fundamentals Methods and ApplicationsUSA 5-7 May 2010

Submissions are Opened

Events amp Publications

bull Books Journals and special issues

Joatildeo Manuel R S Tavares 94A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-editor-in-chief Int Journal for Computational Vision and Biomechanics (IJCVampB)ISSN 0973-6778 Serials Publications

Co-editor Proceedings of the ENVC2005 ndash National Meeting on Scientific VisualizationISBN 972-99872-0-3 Fundaccedilatildeo Navegar 2005

Co-editor Proceedings of the International Symposium CompIMAGE 2006ISBN 9780415433495 Taylor and Francis 2007

Events amp Publications

bull Books Journals and special issues

Joatildeo Manuel R S Tavares 95A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Guest-co-editor Special issue of the International Journal of Simulation Modelling (IJSM) dedicated to CompIMAGE 2006ISSN 1726-4529 Vol 6 N 2 June 2007 pp 61-136

Guest-co-editor Special issue of Electronic Letters on Computer Vision and Image Analysis (ELCVIA) dedicated to CompIMAGE 2006ISSN 1577-5097 Vol 7 N 2 May 2008

Events amp Publications

bull Books Journals and special issues

Joatildeo Manuel R S Tavares 96A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Co-editor Proceedings of the I ECCOMAS Thematic Conference on Computational Vision and Medical Image Processing VipIMAGE 2007ISBN 9780415457774 Taylor and Francis 2007

Co-editor Advances in Computational Vision and Medical Image Processing Methods and ApplicationsComputational Methods in Applied Sciences Vol 13 ISBN 1402090854 Springer 2008

Events amp Publications

bull Books Journals and special issues

Joatildeo Manuel R S Tavares 97A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Guest-co-editor Special issue of the International Journal of Tomography amp Statistics on Image ProcessingISSN 0973-7294 Vol 15 N W10 Winter 2010 amp Vol 16 N S10 Summer 2010

Co-editor Fourteenth Annual Scientific Conference on web Technology New Media Communications and Telematics Theory and ApplicationsISBN 978-90-77381-38-0 EUROSIS-ETI 2008

Events amp Publications

bull Books Journals and special issues

Joatildeo Manuel R S Tavares 98A computer analysis of structures in image sequences methods and applications

See wwwfeuppt~tavares

Guest-co-editor Special issue of the EURASIP Journal on Advances in Signal Processing on Image Processing and Analysis in BiomechanicsISSN 1687-6172 Hindawi Publishing Corporation

Co-editor Proceedings of the 1st International Conference on Imaging Theory and Applications (IMAGAPP)ISSN 978-989-8111-68-5 INSTICC Press 2009

Submission is Opened

Research Team(Computational Vision)

Research Team (Computational Vision)

bull PhD students (12)ndash In course Raquel Pinho Patriacutecia Gonccedilalves Maria

Vasconcelos Ilda Reis Teresa Azevedo Daniel Moura Zhen Ma Elza Chagas Victor Albuquerque Francisco Oliveira Eduardo Ribeiro Eduardo Gomes

bull MSc students (13)ndash In course Fernando Carvalho Mauro Trindade Lara Quintela

Frederico Jacob Veroacutenica Marquesndash Finished Daniela Sousa Francisco Oliveira Teresa Azevedo

Maria Vasconcelos Raquel Pinho Luiacutesa Bastos CacircndidaCoelho Jorge Gonccedilalves

bull BSc students (2)ndash Finished Ricardo Ferreira Soraia Pimenta

Joatildeo Manuel R S Tavares 100A computer analysis of structures in image sequences methods and applications

Research Team (Computational Vision)

bull Collaboratorsndash Renato Natal Jorge Joaquim Gabriel Maacuterio Vaz Miguel

Velhote Jorge Barbosa Francisco Freitas (FEUP)ndash Nuno Correia (INEGI)ndash Luiacutes Duratildeo (ISEP)ndash Emiacutelia Mendes (CRPG)ndash Denilson Rodrigues (PUC - Minas Gerais Brazil)ndash Diana Miranda Georgeta Oliveira Ricardo Duarte (HPH)ndash Ana Mafalda Reis Manuel Laranjeira (ICBASINC)ndash Manuel Paulo (FMDUP)ndash Adelino Leite-Moreira (FMUP)ndash Filipa Sousa Joatildeo Paulo Vilas-Boas (FCDUP)

Joatildeo Manuel R S Tavares 101A computer analysis of structures in image sequences methods and applications

Research Team (Computational Vision)

bull Collaboratorsndash Durval C Costa (HPP-Medicina Molecular SA)ndash Luis Metello (ESTSP)ndash Chandrajit Bajaj (UTA USA)ndash Todd Pataky (University of Liverpool UK)ndash Chris Constantinou (Stanford University of Medicine USA)ndash Isabel Figueiredo (FCTUC)ndash Adeacutelia Cerqueira (IST)ndash hellip

Joatildeo Manuel R S Tavares 102A computer analysis of structures in image sequences methods and applications

Conclusions and Future Working Perspectives

Conclusions and Future Working Perspectives

bull The computer analysis of structures in images is a very complex task but of raised importance in many domains

bull Numerous complex challenges exist as for example structures with topological variations complex movements adverse conditions in the image acquisition processes etc

bull Much work was already developed in this Computational Vision area but important and complex goals still to be successfully addressed

bull Methods and methodologies of other research areas as of Mathematics Computational Mechanics and Biology can contribute significantly for its development

bull For that collaborations are mostly welcome

Joatildeo Manuel R S Tavares 104A computer analysis of structures in image sequences methods and applications

Mathematical Aspects of Imaging Modeling and Visualization in Multiscale BiologyMarch 31 ndash April 4 2009 The University of Texas at Austin USA

A computer analysis of structures in image sequences methods and applications

Joatildeo Manuel R S Tavares

tavaresfeuppt wwwfeuppt~tavares

• Slide Number 1
• Outline
• Presentation
• Presentation
• FEUP Identity
• FEUP PORTO World heritage
• FEUP Some Numbers
• INEGI Identity
• INEGI Identity
• INEGI Identity
• Introduction Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Tasks and ApplicationsStructures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Tasks and ApplicationsStructures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Tasks and ApplicationsStructures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching
• Structures Matching
• Structures Matching
• Structures Morphing
• Structures Morphing
• Structures Registration
• Structures Registration
• Structures Registration
• Structures Registration
• Tasks and ApplicationsStructures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Human Perception andData Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Research Projects ampPhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Scientific Events amp Publications
• Scientific Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Research Team(Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Conclusions and Future Working Perspectives
• Conclusions and Future Working Perspectives
• Slide Number 105

Research Team (Computational Vision)

bull PhD students (12)ndash In course Raquel Pinho Patriacutecia Gonccedilalves Maria

Vasconcelos Ilda Reis Teresa Azevedo Daniel Moura Zhen Ma Elza Chagas Victor Albuquerque Francisco Oliveira Eduardo Ribeiro Eduardo Gomes

bull MSc students (13)ndash In course Fernando Carvalho Mauro Trindade Lara Quintela

Frederico Jacob Veroacutenica Marquesndash Finished Daniela Sousa Francisco Oliveira Teresa Azevedo

Maria Vasconcelos Raquel Pinho Luiacutesa Bastos CacircndidaCoelho Jorge Gonccedilalves

bull BSc students (2)ndash Finished Ricardo Ferreira Soraia Pimenta

Joatildeo Manuel R S Tavares 100A computer analysis of structures in image sequences methods and applications

Research Team (Computational Vision)

bull Collaboratorsndash Renato Natal Jorge Joaquim Gabriel Maacuterio Vaz Miguel

Velhote Jorge Barbosa Francisco Freitas (FEUP)ndash Nuno Correia (INEGI)ndash Luiacutes Duratildeo (ISEP)ndash Emiacutelia Mendes (CRPG)ndash Denilson Rodrigues (PUC - Minas Gerais Brazil)ndash Diana Miranda Georgeta Oliveira Ricardo Duarte (HPH)ndash Ana Mafalda Reis Manuel Laranjeira (ICBASINC)ndash Manuel Paulo (FMDUP)ndash Adelino Leite-Moreira (FMUP)ndash Filipa Sousa Joatildeo Paulo Vilas-Boas (FCDUP)

Joatildeo Manuel R S Tavares 101A computer analysis of structures in image sequences methods and applications

Research Team (Computational Vision)

bull Collaboratorsndash Durval C Costa (HPP-Medicina Molecular SA)ndash Luis Metello (ESTSP)ndash Chandrajit Bajaj (UTA USA)ndash Todd Pataky (University of Liverpool UK)ndash Chris Constantinou (Stanford University of Medicine USA)ndash Isabel Figueiredo (FCTUC)ndash Adeacutelia Cerqueira (IST)ndash hellip

Joatildeo Manuel R S Tavares 102A computer analysis of structures in image sequences methods and applications

Conclusions and Future Working Perspectives

Conclusions and Future Working Perspectives

bull The computer analysis of structures in images is a very complex task but of raised importance in many domains

bull Numerous complex challenges exist as for example structures with topological variations complex movements adverse conditions in the image acquisition processes etc

bull Much work was already developed in this Computational Vision area but important and complex goals still to be successfully addressed

bull Methods and methodologies of other research areas as of Mathematics Computational Mechanics and Biology can contribute significantly for its development

bull For that collaborations are mostly welcome

Joatildeo Manuel R S Tavares 104A computer analysis of structures in image sequences methods and applications

Mathematical Aspects of Imaging Modeling and Visualization in Multiscale BiologyMarch 31 ndash April 4 2009 The University of Texas at Austin USA

A computer analysis of structures in image sequences methods and applications

Joatildeo Manuel R S Tavares

tavaresfeuppt wwwfeuppt~tavares

• Slide Number 1
• Outline
• Presentation
• Presentation
• FEUP Identity
• FEUP PORTO World heritage
• FEUP Some Numbers
• INEGI Identity
• INEGI Identity
• INEGI Identity
• Introduction Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Tasks and ApplicationsStructures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Tasks and ApplicationsStructures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Tasks and ApplicationsStructures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching
• Structures Matching
• Structures Matching
• Structures Morphing
• Structures Morphing
• Structures Registration
• Structures Registration
• Structures Registration
• Structures Registration
• Tasks and ApplicationsStructures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Human Perception andData Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Research Projects ampPhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Scientific Events amp Publications
• Scientific Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Research Team(Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Conclusions and Future Working Perspectives
• Conclusions and Future Working Perspectives
• Slide Number 105

Research Team (Computational Vision)

bull Collaboratorsndash Renato Natal Jorge Joaquim Gabriel Maacuterio Vaz Miguel

Velhote Jorge Barbosa Francisco Freitas (FEUP)ndash Nuno Correia (INEGI)ndash Luiacutes Duratildeo (ISEP)ndash Emiacutelia Mendes (CRPG)ndash Denilson Rodrigues (PUC - Minas Gerais Brazil)ndash Diana Miranda Georgeta Oliveira Ricardo Duarte (HPH)ndash Ana Mafalda Reis Manuel Laranjeira (ICBASINC)ndash Manuel Paulo (FMDUP)ndash Adelino Leite-Moreira (FMUP)ndash Filipa Sousa Joatildeo Paulo Vilas-Boas (FCDUP)

Joatildeo Manuel R S Tavares 101A computer analysis of structures in image sequences methods and applications

Research Team (Computational Vision)

bull Collaboratorsndash Durval C Costa (HPP-Medicina Molecular SA)ndash Luis Metello (ESTSP)ndash Chandrajit Bajaj (UTA USA)ndash Todd Pataky (University of Liverpool UK)ndash Chris Constantinou (Stanford University of Medicine USA)ndash Isabel Figueiredo (FCTUC)ndash Adeacutelia Cerqueira (IST)ndash hellip

Joatildeo Manuel R S Tavares 102A computer analysis of structures in image sequences methods and applications

Conclusions and Future Working Perspectives

Conclusions and Future Working Perspectives

bull The computer analysis of structures in images is a very complex task but of raised importance in many domains

bull Numerous complex challenges exist as for example structures with topological variations complex movements adverse conditions in the image acquisition processes etc

bull Much work was already developed in this Computational Vision area but important and complex goals still to be successfully addressed

bull Methods and methodologies of other research areas as of Mathematics Computational Mechanics and Biology can contribute significantly for its development

bull For that collaborations are mostly welcome

Joatildeo Manuel R S Tavares 104A computer analysis of structures in image sequences methods and applications

Mathematical Aspects of Imaging Modeling and Visualization in Multiscale BiologyMarch 31 ndash April 4 2009 The University of Texas at Austin USA

A computer analysis of structures in image sequences methods and applications

Joatildeo Manuel R S Tavares

tavaresfeuppt wwwfeuppt~tavares

• Slide Number 1
• Outline
• Presentation
• Presentation
• FEUP Identity
• FEUP PORTO World heritage
• FEUP Some Numbers
• INEGI Identity
• INEGI Identity
• INEGI Identity
• Introduction Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Tasks and ApplicationsStructures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Tasks and ApplicationsStructures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Tasks and ApplicationsStructures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching
• Structures Matching
• Structures Matching
• Structures Morphing
• Structures Morphing
• Structures Registration
• Structures Registration
• Structures Registration
• Structures Registration
• Tasks and ApplicationsStructures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Human Perception andData Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Research Projects ampPhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Scientific Events amp Publications
• Scientific Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Research Team(Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Conclusions and Future Working Perspectives
• Conclusions and Future Working Perspectives
• Slide Number 105

Research Team (Computational Vision)

bull Collaboratorsndash Durval C Costa (HPP-Medicina Molecular SA)ndash Luis Metello (ESTSP)ndash Chandrajit Bajaj (UTA USA)ndash Todd Pataky (University of Liverpool UK)ndash Chris Constantinou (Stanford University of Medicine USA)ndash Isabel Figueiredo (FCTUC)ndash Adeacutelia Cerqueira (IST)ndash hellip

Joatildeo Manuel R S Tavares 102A computer analysis of structures in image sequences methods and applications

Conclusions and Future Working Perspectives

Conclusions and Future Working Perspectives

bull The computer analysis of structures in images is a very complex task but of raised importance in many domains

bull Numerous complex challenges exist as for example structures with topological variations complex movements adverse conditions in the image acquisition processes etc

bull Much work was already developed in this Computational Vision area but important and complex goals still to be successfully addressed

bull Methods and methodologies of other research areas as of Mathematics Computational Mechanics and Biology can contribute significantly for its development

bull For that collaborations are mostly welcome

Joatildeo Manuel R S Tavares 104A computer analysis of structures in image sequences methods and applications

Mathematical Aspects of Imaging Modeling and Visualization in Multiscale BiologyMarch 31 ndash April 4 2009 The University of Texas at Austin USA

A computer analysis of structures in image sequences methods and applications

Joatildeo Manuel R S Tavares

tavaresfeuppt wwwfeuppt~tavares

• Slide Number 1
• Outline
• Presentation
• Presentation
• FEUP Identity
• FEUP PORTO World heritage
• FEUP Some Numbers
• INEGI Identity
• INEGI Identity
• INEGI Identity
• Introduction Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Tasks and ApplicationsStructures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Tasks and ApplicationsStructures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Tasks and ApplicationsStructures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching
• Structures Matching
• Structures Matching
• Structures Morphing
• Structures Morphing
• Structures Registration
• Structures Registration
• Structures Registration
• Structures Registration
• Tasks and ApplicationsStructures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Human Perception andData Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Research Projects ampPhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Scientific Events amp Publications
• Scientific Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Research Team(Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Conclusions and Future Working Perspectives
• Conclusions and Future Working Perspectives
• Slide Number 105

Conclusions and Future Working Perspectives

Conclusions and Future Working Perspectives

bull The computer analysis of structures in images is a very complex task but of raised importance in many domains

bull Numerous complex challenges exist as for example structures with topological variations complex movements adverse conditions in the image acquisition processes etc

bull Much work was already developed in this Computational Vision area but important and complex goals still to be successfully addressed

bull Methods and methodologies of other research areas as of Mathematics Computational Mechanics and Biology can contribute significantly for its development

bull For that collaborations are mostly welcome

Joatildeo Manuel R S Tavares 104A computer analysis of structures in image sequences methods and applications

Mathematical Aspects of Imaging Modeling and Visualization in Multiscale BiologyMarch 31 ndash April 4 2009 The University of Texas at Austin USA

A computer analysis of structures in image sequences methods and applications

Joatildeo Manuel R S Tavares

tavaresfeuppt wwwfeuppt~tavares

• Slide Number 1
• Outline
• Presentation
• Presentation
• FEUP Identity
• FEUP PORTO World heritage
• FEUP Some Numbers
• INEGI Identity
• INEGI Identity
• INEGI Identity
• Introduction Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Tasks and ApplicationsStructures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Tasks and ApplicationsStructures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Tasks and ApplicationsStructures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching
• Structures Matching
• Structures Matching
• Structures Morphing
• Structures Morphing
• Structures Registration
• Structures Registration
• Structures Registration
• Structures Registration
• Tasks and ApplicationsStructures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Human Perception andData Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Research Projects ampPhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Scientific Events amp Publications
• Scientific Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Research Team(Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Conclusions and Future Working Perspectives
• Conclusions and Future Working Perspectives
• Slide Number 105

Conclusions and Future Working Perspectives

bull The computer analysis of structures in images is a very complex task but of raised importance in many domains

bull Numerous complex challenges exist as for example structures with topological variations complex movements adverse conditions in the image acquisition processes etc

bull Much work was already developed in this Computational Vision area but important and complex goals still to be successfully addressed

bull Methods and methodologies of other research areas as of Mathematics Computational Mechanics and Biology can contribute significantly for its development

bull For that collaborations are mostly welcome

Joatildeo Manuel R S Tavares 104A computer analysis of structures in image sequences methods and applications

Mathematical Aspects of Imaging Modeling and Visualization in Multiscale BiologyMarch 31 ndash April 4 2009 The University of Texas at Austin USA

A computer analysis of structures in image sequences methods and applications

Joatildeo Manuel R S Tavares

tavaresfeuppt wwwfeuppt~tavares

• Slide Number 1
• Outline
• Presentation
• Presentation
• FEUP Identity
• FEUP PORTO World heritage
• FEUP Some Numbers
• INEGI Identity
• INEGI Identity
• INEGI Identity
• Introduction Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Tasks and ApplicationsStructures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Tasks and ApplicationsStructures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Tasks and ApplicationsStructures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching
• Structures Matching
• Structures Matching
• Structures Morphing
• Structures Morphing
• Structures Registration
• Structures Registration
• Structures Registration
• Structures Registration
• Tasks and ApplicationsStructures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Human Perception andData Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Research Projects ampPhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Scientific Events amp Publications
• Scientific Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Research Team(Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Conclusions and Future Working Perspectives
• Conclusions and Future Working Perspectives
• Slide Number 105

Mathematical Aspects of Imaging Modeling and Visualization in Multiscale BiologyMarch 31 ndash April 4 2009 The University of Texas at Austin USA

A computer analysis of structures in image sequences methods and applications

Joatildeo Manuel R S Tavares

tavaresfeuppt wwwfeuppt~tavares

• Slide Number 1
• Outline
• Presentation
• Presentation
• FEUP Identity
• FEUP PORTO World heritage
• FEUP Some Numbers
• INEGI Identity
• INEGI Identity
• INEGI Identity
• Introduction Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Computer Analysis of Structures in Image Sequences
• Tasks and ApplicationsStructures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Structures Segmentation
• Tasks and ApplicationsStructures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Structures Tracking
• Tasks and ApplicationsStructures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching Registration and Morphing
• Structures Matching
• Structures Matching
• Structures Matching
• Structures Morphing
• Structures Morphing
• Structures Registration
• Structures Registration
• Structures Registration
• Structures Registration
• Tasks and ApplicationsStructures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Structures 3D Reconstruction
• Human Perception andData Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Human Perception and Data Visualization
• Research Projects ampPhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Research Projects amp PhD Thesis
• Scientific Events amp Publications
• Scientific Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Events amp Publications
• Research Team(Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Research Team (Computational Vision)
• Conclusions and Future Working Perspectives
• Conclusions and Future Working Perspectives
• Slide Number 105