1. Introduction Applications and librairy RoadmapThe Orfeo Toolbox Remote Sensing ImageProcessing Software J. Inglada1 , E. Christophe21 C ENTRE N ATIONAL D TUDES S PATIALES , TOULOUSE , F RANCE2 C ENTRE FOR R EMOTE I MAGING , S ENSING AND P ROCESSING , N ATIONAL U NIVERSITY OF S INGAPOREIGARSS 2009, Cape Town

2. Introduction Applications and librairy Roadmap What When Why How OutlineIntroductionWhat is it?A bit of historyWhy doing that?How? Applications and librairyComponentsArchitectureBut steep learning Whats coming next?New applications for OTB 3.2GIS integrationBindingsGPU and clusters IGARSS 2009, Cape Town 3. Introduction Applications and librairy Roadmap What When Why How What is Orfeo Toolbox (OTB)?In the frame of CNES ORFEO Program Goal Make the development of new algorithms and their validation easierC++ library: provide many algorithms (pre-processing,image analysis) with a common interfaceOpen-source: free to use, to modify, you can make yourown software based on OTB and sell itMultiplatform: Windows, Linux, Unix, Mac IGARSS 2009, Cape Town 4. Introduction Applications and librairy Roadmap What When Why How A bit of History Everything begins (2006)Started in 2006 by CNES (French Space Agency), funding several full-timedevelopersTargeted at high resolution images (Pleiades to be launched in 2010) but withapplication to other sensors4 year budget, over 1,000,000eMoving to user friendly applications (2008)Strong interactions with the user community highlighted that applications fornon-programmers are importantSeveral applications for non programmers (with GUI) since early 2008Several courses (3/5-day courses) given in several French and Belgianinstitutions (Cesbio, RMA, ENST,...)IGARSS 2009, Cape Town 5. Introduction Applications and librairy Roadmap What When Why How Why doing that?Is it successful so far?OTB user community growing steadily (programmers and application users)Presented at IGARSS and ISPRS in 2008, special session in IGARSS in 2009CNES is planning to extend the budget for several more yearsValue analysis is very positive (cf. Ohloh): re-using is powerful IGARSS 2009, Cape Town 6. Introduction Applications and librairy Roadmap What When Why How Why doing that?Is it successful so far?OTB user community growing steadily (programmers and application users)Presented at IGARSS and ISPRS in 2008, special session in IGARSS in 2009CNES is planning to extend the budget for several more yearsValue analysis is very positive (cf. Ohloh): re-using is powerful Why make a multi-million dollar software and give it for free?CNES is not a software companyOne goal is to encourage research: it is critical for researchers to know what is inthe boxCNES makes satellites and wants to make sure the images are usedif more people have the tools to use satellite images, it is good for CNESIGARSS 2009, Cape Town 7. Introduction Applications and librairy Roadmap What When Why How How?How to reach this goal? Using the best work of others: do not reinvent the wheelIGARSS 2009, Cape Town 8. Introduction Applications and librairy Roadmap What When Why How How?How to reach this goal? Using the best work of others: do not reinvent the wheelMany open-source libraries of good quality ITK: software architecture (streaming, multithreading), many image processing algorithms Gdal/Ogr: reading data format (geotiff, raw, png, jpeg, shapele, . . . ) Ossim: sensor models (Spot, RPC, SAR, . . . ) and map projections 6S: radiometric corrections and many other: libLAS (lidar data), Edison (Mean Shift clustering), libSiftFast (SIFT), Boost (graph), libSVM (Support Vector Machines) all behind a common interfaceIGARSS 2009, Cape Town 9. Introduction Applications and librairy Roadmap Components Architecture But OutlineIntroductionWhat is it?A bit of historyWhy doing that?How? Applications and librairyComponentsArchitectureBut steep learning Whats coming next?New applications for OTB 3.2GIS integrationBindingsGPU and clusters IGARSS 2009, Cape Town 10. Introduction Applications and librairy Roadmap Components Architecture But Application CurrentlyImage viewerImage SegmentationImage Classication (by SVM)Land CoverFeature ExtractionRoad ExtractionOrthorectication (with Pan Sharpening)Fine registrationImage to database registrationObject countingUrban area detectionmore to come IGARSS 2009, Cape Town 11. Introduction Applications and librairy Roadmap Components Architecture But Components available Currently Most satellite image formats Geometric corrections Radiometric corrections Change detection Feature extraction Classication Huge documentation available Software Guide (+600 pages pdf), also the online version Doxygen: documentation for developersIGARSS 2009, Cape Town 12. Introduction Applications and librairy Roadmap Components Architecture But A powerful architecture ModularEasy to combine different blocks to do new processingScalableStreaming (processing huge images on the ow) transparent for the user of thelibraryMultithreading (using multicore CPUs) also IGARSS 2009, Cape Town 13. Introduction Applications and librairy Roadmap Components Architecture But But a steep learning curve for the programmerAdvanced programming conceptsTemplate metaprogramming (generic programming)Design patterns (Factory, Functors, Smart Pointers, ...) IGARSS 2009, Cape Town 14. Introduction Applications and librairy Roadmap Components Architecture But But a steep learning curve for the programmerAdvanced programming conceptsTemplate metaprogramming (generic programming)Design patterns (Factory, Functors, Smart Pointers, ...) IGARSS 2009, Cape Town 15. Introduction Applications and librairy Roadmap Components Architecture But Ask questions As for everything: easier when youre not aloneMuch easier if you have somebody around to help!We didnt know anything not so long ago...Not surprising that most software companies now focus their offer on support:help is important IGARSS 2009, Cape Town 16. Introduction Applications and librairy Roadmap Application GIS integration Bindings GPU and clusters OutlineIntroductionWhat is it?A bit of historyWhy doing that?How? Applications and librairyComponentsArchitectureBut steep learning Whats coming next?New applications for OTB 3.2GIS integrationBindingsGPU and clusters IGARSS 2009, Cape Town 17. Introduction Applications and librairy Roadmap Application GIS integration Bindings GPU and clusters New applications for OTB 3.2Tree stand extractionRadiometric calibration application (Optical and radar)Improvement of the land cover application (use of textures) IGARSS 2009, Cape Town 18. Introduction Applications and librairy Roadmap Application GIS integration Bindings GPU and clusters GIS integrationPostGISWork in progress to integrate the connection to PostGIS database (IO)Querying: use the geographic capabilities in feature extraction algorithms (abuilding has a shadow in the north west for example) IGARSS 2009, Cape Town 19. Introduction Applications and librairy Roadmap Application GIS integration Bindings GPU and clusters GIS integration Quantum GISQuantum GIS is a very user-friendly open source GIS applicationWork going on to access the OTB capabilities within Quantum GIS (plugins) IGARSS 2009, Cape Town 20. Introduction Applications and librairy Roadmap Application GIS integration Bindings GPU and clusters GIS integrationMappingStronger integration with mapping and data representationIntegration of Mapnik, Open Street Map data IGARSS 2009, Cape Town 21. Introduction Applications and librairy Roadmap Application GIS integration Bindings GPU and clusters Bindings: access through other languagesNot everybody uses C++!Bindings provide an access to the library through other languagesPython: mostly working but not fully testedJava: some work is still needed to be able to use OTB from java but most of thework is already doneIDL/Envi: cooperation with ITT VIS to provide a method to access OTB throughidl/envi (working but no automatic generation)Matlab: recent user contribution (R. Bellens from TU Delft)Other languages supported by Cable Swig might be possible (Tcl, Ruby?) IGARSS 2009, Cape Town 22. Introduction Applications and librairy Roadmap Application GIS integration Bindings GPU and clusters GPU and clusters Now Can automatically use several cores on the same CPU (shared memory) This is transparent for the user thanks to the ITK architecture GPU and clusters Some talks are going on between ITK and OTB to nd the best solution: general, easy to use... Cuda is too dependent on the hardware but OpenCL is leading an effort to get a common architecture (Apple, AMD, Intel, Nvidia) Probably some novelties in the coming monthsIGARSS 2009, Cape Town