state of the art cross platform shader development with fx...

State of the Art Cross Platform Shader

Development with FX Composer 2

Ignacio CastañoDaniel Horowitz

Copyright © NVIDIA Corporation 2004

Agenda

FX Composer 2.0 OverviewCross-Platform Shader AuthoringProduction Pipeline IntegrationConclusionQ&A


FX Composer 2.0What and Who?

What is it for?Shader Authoring IDEDebugging and ProfilingScene IntegrationAsset Management

Who is it for?Graphics ProgrammersTechnical DirectorsTechnical ArtistsArtists

http://images.google.com/imgres?imgurl=http://www.amigahistory.co.uk/3dgraphbk.jpg&imgrefurl=http://www.amigahistory.co.uk/books.html&h=480&w=348&sz=28&hl=en&start=15&tbnid=vERvB1eBnc4aDM:&tbnh=126&tbnw=91&prev=/images%3Fq%3D3d%2Bgraphics%2Bprogrammer%26svnum%3D10%26hl%3Den%26lr%3D

http://images.google.com/imgres?imgurl=http://www.hothardware.com/reviews/images/nvcg/CG_100x100.jpg&imgrefurl=http://www.hothardware.com/viewarticle.cfm%3Farticleid%3D436&h=82&w=100&sz=2&hl=en&start=241&tbnid=bDpzDljxXMYYAM:&tbnh=63&tbnw=77&prev=/images%3Fq%3D3d%2Bgraphics%2Bprogrammer%26start%3D234%26ndsp%3D18%26svnum%3D10%26hl%3Den%26lr%3D%26sa%3DN

http://www.valdyas.org/python/book.html

http://images.google.com/imgres?imgurl=http://www.exploritech.com/images/mainImage6.jpg&imgrefurl=http://www.exploritech.com/&h=350&w=350&sz=25&hl=en&start=69&tbnid=QoZu44RYU7f4iM:&tbnh=116&tbnw=116&prev=/images%3Fq%3D3d%2Bgraphics%2Bprogrammer%26start%3D54%26ndsp%3D18%26svnum%3D10%26hl%3Den%26lr%3D%26sa%3DN

http://images.google.com/imgres?imgurl=http://www.applied-ideas.com/3dservices/images/AsianFemaleHead2.jpg&imgrefurl=http://www.applied-ideas.com/contact.html&h=243&w=320&sz=14&hl=en&start=78&tbnid=KZZLas-g95lZxM:&tbnh=85&tbnw=113&prev=/images%3Fq%3D3d%2Bgraphics%2Bprogrammer%26start%3D72%26ndsp%3D18%26svnum%3D10%26hl%3Den%26lr%3D%26sa%3DN

http://images.google.com/imgres?imgurl=http://www.chip.de/ii/84869783_ebc493e3ec.jpg&imgrefurl=http://www.chip.de/news/c1_news_20422188.html&h=175&w=144&sz=12&hl=en&start=9&tbnid=uM4m5k5d6KY5wM:&tbnh=95&tbnw=78&prev=/images%3Fq%3DMicrosoft%2BHLSL%26svnum%3D10%26hl%3Den%26lr%3D

http://images.google.com/imgres?imgurl=http://images.amazon.com/images/P/012553180X.01._SCLZZZZZZZ_V110188316_.jpg&imgrefurl=http://www.amazon.co.jp/gp/product/images/012553180X%3F_encoding%3DUTF8&h=500&w=434&sz=58&hl=en&start=14&tbnid=kozJcC90Spc9HM:&tbnh=130&tbnw=113&prev=/images%3Fq%3Dphysically-based%2Brendering%26svnum%3D10%26hl%3Den%26lr%3D%26sa%3DG


Your Requirements

Handling of complex renderingHighly customizable layout managementPowerful user interfaceShader performance profilingPlug-in based architectureScriptable


Flexible Render

Many API & shading language combinationsOpenGL, Direct3D, PlayStation3™, OpenGL ES*Cg, HLSL, GLSL*

Surface and fullscreen shaders


Improved User Interface

Customized user layouts

Show or hide panels

VC2005 docking style

Save/Load layouts


Improved User Interface


Typical FX Composer LayoutProperties

PreviewInfo, Scripting, ErrorsTextures

CodingManagement


DEMO:Shader Authoring

Loading ProjectCompilingErrors and Tasks


Project Explorer

Manage multiple documents

Documents contain multiple assets

Assets are effects, materials, meshes, and other scene elements

Organize you assetsMove, copy, delete, renameDrag and dropOne or many documentsEffect Libraries

COLLADA


Open asset exchange format (.dae)

Governed by the Khronos GroupIncludes numerous ISVs and IHVsMature DCC plugins for extensive support

Supported by FX Composer 2Import & ExportSupports effects and materialsFacilitates asset exchange with DCC appsOther file formats supported


Library View

Organize across documentsSort assets by typeVisualize Assets

ScenesEffect

Authoring


Effect Authoring

View effect structureTechniquesPassesParameters

Authoring using toolbars and context menus

Add childrenRemove childrenAdvanced options


CgFX & COLLADA FX Cg

CgFXHand codedLess user interface assistance

COLLADA FX for Cg authoringMost user friendly experienceFully editable via user interfaceCan migrate your CgFX assetsLess hand coding

Zero XMLCg, GLSL only when writing the GPU shader code


DEMO:Material Authoring

Creating materialsAssigning effectsTweaking material parameters


DEMO:Scene Integration

Light creationScene traversalBind light to materialRealtime manipulation


Shader Performance Simulation


Speaker Transition

Daniel Horowitz


Production Pipeline Integration

Scene binding expressionsAutomation via scriptingPlug-in based architectureSource control integrationProduction Pipeline Samples


Scene binding expressions

float4 LightPos : Position<

string Object = "PointLight";string Space = "Object";

> = {-10.0f, 10.0f, -10.0f, 0.0f};

Semantic

Annotations


Custom Semantics and Annotations

1 :<RemappedSemantic name="myWorldView">2 : <MatrixMultiply description="World * View">3 : <input type="internalsemantic" value="world"/>4 : <input type="internalsemantic" value="view"/>5 : </MatrixMultiply>6 :</RemappedSemantic>

Hook parameter to scene and system dataExpressions via xml configuration fileExtensive Library of Operators

dot & cross products, mux, demux, matrix ops, ...Custom operators

Built from XML using operatorsVia plug-in


Automation Via Scripting

Automatic assignment of Materials to geometryShader parameters to scene objects (nearest lights, cameras, etc...)A model’s accessories to attachment points

Common-tasks toolbar (ala Maya/MEL)


Automation Via Scripting

#Python scripting

# Convert any Possible Profile to COLLADA FXdef ConvertToCOLLADA():

effects = FXRuntime.Instance.Library.FindLibraryItems(FXEffect)for effect in effects:

for profile in effect.Profiles:if profile.CanConvertToColladaFX() == True:

profile.ConvertToColladaFX()

# Create an effectdef bindMMM():

CmdGroupBegin.Do("script: assign cgfx files to MMM ")

SelectRenderPort("OpenGL")ForceRedraw()

CmdGroupEnd.Do()

# get the cgfx files to assign to MMM

files = FXEffectUtils.GetEffectFiles()for pathname in files:

...


DEMO:Scripting

Automatic effect loading & assignment


Custom Plug-ins

Importers ExportersSemantic expression operatorsRendering devicesProcedural geometry generation (fins, hair, etc...)Custom authoring environment

…etc…


Custom Plug-ins: Sky is the limit


Source Control Integration

Seamless integration into source control softwareDocuments and assets reflect file-based state


ConsolePCMAC

Pipelines: FXC2 centric

FX Composer 2.0

COLLADA Scene with FX

COLLADADCC

Geometry

Conditioners and Compilers

GameBinary

Effects

GameBinary

GameBinary


Pipelines: DCC centric

FXComposer

2.0

DCCApplication

Conditioner

SceneEffectLibrary

Console

GameBinary


Pipelines: Handheld

FX Composer 2.0 ESRemoteRender

Data Conditionerand Compiler

Host PC Target Handheld

DCC ToolsXSI, Max Maya

GameEngine

COLLADA


Pipelines: Engine

FX Composer 2.0

Game Importer

CgFX

GameBinary

D3D FX

COLLADA FX

Rendering Game Adapter Game Engine

GameBinary


FX Composer 2.0 Alpha 5

Alpha5 release ETA end of summer ’06Document and asset managementCOLLADA FX authoringShader parameter scene bindingCustom semantic and annotation supportPython scriptingShader performanceAvailable to Sony PS3 developers and limited partners

Beta release ETA end of fall ’06Open to public


Conclusion

Next-generation of shader IDE is on its wayProduction-ready with powerful featuresNVIDIA is closely working with Khronos and others to deliver a professional-grade authoring tool


Q&A

Send us emails for early alpha and beta releases

[email protected]

ThanksIgnacio Castaño ([email protected])Daniel Horowitz ([email protected])