tvpaint tutorial 8

8/14/2019 TVPaint Tutorial 8

1/23

Lesson 8

Sound and XSheet

In this lesson you will :

Manage the Audio Multi Tracks.

Learn to use the XSheet layers.

Make a Lip-Sync.


2/23

Audio Multi Tracks

Audio Multi Tracks

All the audio parameters are availale in the second part o! the Time Line window" etween theNotesand the Layers.

The audio section can e separated into two parts. #n the le!t side" there are all the parameters o!

the tracks $name" volume" o!!set" ...% and on the right side" there is a preview o! the track during theanimation.&ust a little word aout the Master Track" it is a sort o! special track. It always e'ists even i! no trackis loaded. This !unctionality will e detailed elow. #therwise" all the imported tracks add a newentry under the Master Track.

The sound track here" in the Clip : timeline ta is a (local) sound. A (gloal) sound"whose the use is very similar to the local sound" also e'ists. It will e discussed inlesson *.

How to add audio tracks to a project

There are two ways to add new audio tracks to a pro+ect., In the main menu" the Project > Load Sound ...option opens a panel to choose the audio !ile toimport., In the le!t side o! the audio section" a click on the symol elow" to the right o! the Master Trackname" opens a popup menu and allows you to Load a Sound Track... .

I! you have already loaded tracks" a history o! thepreviously loaded !iles will appears in this popupmenu under the Load a Sound Track ...option.

- Sound and XSheet


3/23

Audio Multi Tracks

/ow it is possile to load several tracks on a pro+ect" let0s talk aout the Master Track!unctionality.The aim o! the Master Trackis to merge all the audio tracks" and see preview o! what the !inalsound will look like. 1e can say that the Master Trackis to the pro+ect preview" what the Tracksareto the layers.

The audio tracks parameters

The main audio parameters are availale on the le!t side o! the audio section. 2ere are the various!unctions proposed :

, The triangle at the le!t o! the track name displays the optimi3ed display or the reduced display.

1ith the optimi3ed display" the preview o! the track is more accurate in the right side" and newoptions appear in the le!t side.

, This icon allows you to put sound tracks in a group. Its use is similar to the color groups"discussed in lesson 4.

, This icon shows the sound is audile. I! you click on" you will mute the sound track and this

icon will appear.

5e care!ul" i! the Master Track is muted" no sound will eplayed" even i! your track is active.

/ote that the utton in the current pro+ect window is usedto play a sound track when the pro+ect is viewed.

Sound and XSheet -4


4/23

Audio Multi Tracks

, The triangle at the right side o! the track name opens a popup menu. The options availale aredi!!erent i! the menu is the one o! the Master Trackor o! another Track. The menu with the MasterTrackhas een descried aove. The options availale with the standard tracks are :

6 Lock: allows to lock the current track. All the options which would modi!y the track" are disaled.

6 Duplicate: clones the current track and adds it to the end o! the tracks list.

6 Delete: removes the current track !rom the tracks list.

6 Move down and Move up: respectively allows to move down or move up the sound track $thoseoptions are in grey in you have only one sound track%.

6 !!set... : opens a dialog o' to choose when the track starts inside the animation.

The additional !ollowing options appear when the optimi3ed display is activated:

, 7ou can locka track y clicking on the lack point 8 or via the popup menu. 1hen the track is

locked" this icon appearsThe Master Trackhas no Lockutton" it is no possile to directly modi!y it., The neary check o' is to mute the track. $It is the same check o' o! the reduced display%, And !inally" the slider is the gloal volume o! the track.

The audio tracks preview

Let0s take a look at the right side o! the audio section. All the audio tracks are graphicallyrepresented in this side.

-9 Sound and XSheet


5/23

Audio Multi Tracks

As said previously" the Master Trackis the sum o! all the tracks o! the pro+ect. It0s clearly visilehere.

The o!!set option is already detailed in this susection. /ote that the otherway to modi!y this option is only to click on and drag an audio track $yclicking on its preview%.

Some lue lines can also e seen on each audio track. The aim o! these lines is to allow a asic"adeoption.

, 1hen the lue line is at the ottom o! the audio track" the audio sound is on the minimum $i.e. nosound played%., 1hen the lue line is at the top o! the audio track" the audio sound is on its ma'imum. $Set withthe slider option o! the optimi3ed display%, ;uring the time that the lue line is increasing or decreasing" the program !ades the audio soundin !unction o! the current time and etween the minimum and the ma'imum values o! the audiosound.

It is also possile to add #nnotationson each audio track and at any position. 5y doule clickingon a track" a popup appears $with the current time in its title% and asks the te't which will edisplayed under the cursor position.

1ith a right click on an audio track" a popup menu appears and asks to split the current track. Thisoption doesn0t really split the track" it duplicates the current track and ad+ust the "adeoption onoth to simulate the splitting o! the current track.

Sound and XSheet -


6/23

Audio Multi Tracks

Before Splitting

After Splitting

The =ndo $>u?% and @edo $>Shi!t?>u?% actions areoviously availale !or the audio tracks.

The Preferencespanel options

In the Pre!erencespanel $$dit > Pre!erences%" under the Soundta" more !unctions are availaleconcerning the audio.

, The !irst section o! this ta re!ers to the Scru options.6 The !irst Scru% Durationoption sets the duration o! the scruing.6 The second popup Scru% Mode allows to choose when the tracks should e played" Never"#lways" or only when the user Scru%s.

, The popup Samplin& 'atein the second section" lets the user select the sample rate whereinevery audio tracks will e re-sampled during their import in TBCaint Animation. To have the estresults" all the imported audio tracks should e at the same sample rate than the one given in theSoundta o! the Pre!erencepanel. I! it is not the case" it is o! course possile to import the audiotrack" ut there will e maye a loss o! Duality o! this audio track.

, The last option" Play project sound in clip allows to play the gloal sound when working in

Timeline : clipmode $more in!ormation aout the gloal sound in lesson *%.

-E Sound and XSheet


7/23

The XSheet Layers and XSheet Canel

The XSheet Laers and XSheet !anel

"ntroduction and principle

Maye are you not !amiliar with(S)eet layers and Lip*Syncnotions. 2ere are some in!ormationsregarding their origin :

The word(S)eetcomes !rom e(posure*S)eetor dope*S)eet.It comes !rom the days o! traditional animation when the XSheet was a paper list that numered all!rames o! a scene and in which the animator could write down his drawing numers with the righttiming. $see elow%It helped the animators to plan their animations and also worked as a guide !or the cameraman toknow how to shoot the scene.For instance" synchronising the lips o! a character with a recorded soundtrack $in other wordsdoing a Lip*Sync% was possile with the XSheet.

The(S)eet panel" commonly called(S)eet ta%in TBCaint Animation Cro $see ne't pages% is thedigital transposition o! the classical paper XSheet.

The reason(S)eet panels were included in TBCaint Animation Cro is to make easier to time andsynchronise the animations" thanks to the(S)eet layers.It is also a very use!ul tool !or people who uses to scan their drawings. The main advantage o! the(S)eet layer is that a !rame that is used multiple times in a scene need only to e ad+usted orcolored once and all instances o! this image in the(S)eet layerwill change accordingly.It saves a lot o! time since the process o! copying and editing !rames is much simpler and easier tocontrol through the(S)eet panel. $This is much simpler than the old way in which you0d have tomanually copy and paste !rames in the layers o! the timeline.%

For e'ample" let0s assume that the coloring and the shadows o! a character are on separate layers:I! you need to re-arrange your animation in time" it is always very tedious to edit a layer in thesame way twice or more ... Fortunately" with the(S)eetpanel this can e done really easily and

Duickly.All those notions may seem astract at !irst" ut you can rela'. 1e will Duickly study some concretesituations and e'amples.

Sound and XSheet -G


8/23


The projects used in this chapterTo make the XSheet layers easier to understand" you will have to load the pro+ect !ile$@unning Hid.tvp% !rom your TBCaint Animation Cro ;B;[email protected] who have downloaded the demo version o! the so!tware will !ind this !ile in the download >content s)arin&section o! the TBCaint wesite $www.TBCaint.com%#nce the pro+ect is loaded" you should otain the !ollowing animation and timeline.

Five layers are visile: an image layer called J ackground K and !our animation layers calledJ shadow K" J colors K" J @unning Hid K and J Toonshading K. ach layer has its own assignedcolor.Clease note that the pro+ect does not have any XSheet layer at this time.

#irst approach of the XSheet panel

To swap etween the Timeline and the XSheet panels" you only have to click on the correspondingta $see elow%

Lets study !irst the le!t part o! the XSheet panel. $the right part will e the su+ect o! a !urtherchapter%.

The le!t part o! the(S)eet panel is in a way the mirror o! the Timeline. $see ne't page !or thescreenshots% :

, ach column o! the(S)eet Panelcorresponds to a layer o! the Timeline" with its color. The titleo! a column is the name o! the corresponding layer.

, ach line o! the(S)eet panel is numered. This numering is the same as the one you can !indon the top o! the corresponding timeline $see elow%

, The image layers contain an uniDue image repeated through the time" so they are not sudividedin the XSheet panel.

, As the animation layers contain di!!erent images" they are sudivided.

, The ookmark located here and there on your timeline are also visile and modi!iale in theXSheet panel.

7ou can also use the sliders or the arrow keys o! your keyoard tonavigate through the XSheet panel.

- Sound and XSheet
http://www.tvpaint.com/forum/http://www.tvpaint.com/forum/


9/23


, The thum utton o!!ers several possiilities to change the display mode o! all the layers. 1ith ale!t click on this utton" it swap etween the classical XSheet display and the thumnails display

$see !urther in the section(S)eet ta% +le!t part,%. 5ut i! you right click on it" a popup menu appears"and allows to choose the si3e o! these thumnails.

The si3e o! the thumnails can e Small" Mediumand -i&.

, The second column" etween the column o! the image numer and the !irst layer column" cancontains two in!ormations. It contains oth the Master Sound Track" and the Time Line Notes.

The Master Sound Track and the Time Line/otes are not editale in this column.

There is still the possiility to add some annotations in this column y a doule click" like it is donein the Master Sound Trackin the Time Lineta.

Sound and XSheet -*


10/23


-NO Sound and XSheet


11/23


A few simple options of the XSheet panel

6 6 6 6 6 6 6 6 6 6 6 6 6

Timeline ta$

XSheet ta$

At the ends o! the column" it is still possile to set the pre and post ehavior o! your layers $seene't page%.In the e'ample elow" a !ew pictures !rom the third layer are selected. They are enlightened inyellow in the Timeline and also in the XSheet ta.

Sound and XSheet -NN

A lot o! options regarding the layers areoth availale in the Timeline ta and theXSheet ta.A right click with your mouse utton on animage in the XSheet panel opens aconte'tual menu comparale to the oneencountered via the timeline.

7ou will !ind in this menu some optionsalready encountered in lessons 4 and 9:

, Insert" ;uplicate" ;elete" @ename" Popy"CasteQone or more images.

, Set Cost or Cre ehavior.

, Set #pacity"

etc ...

, The $green or red% colored circle" once you click on it"allows to display or hide the corresponding layer., The small lock utton allows to manage the locking o!a layer., The grey dot under the ul manages the activationo! the light tale., The lack triangles allows to reduce or increase thesi3e o! the columns in the Xheet panel., The current layer is lighter than the other layers.

- The J ackground K layer is hidden- The J Toonshading K layer is locked- The Light Tale o! the J Polors K layer is activated- The J Shadow K layer is reduced- The J @unning-Hid K layer is the current layer

In the XSheet ta opposite :

, The letter J A K indicates that the column representsan animation layer.

, The letter J I K indicates that the column representsan image layer.


12/23


% &Timeline ta$ XSheet ta$

A!ter selecting several layers" the option#li&n le!tand#li&n ri&)t !rom theLayermenuallows to align your layers on either side o! the current image in each ta $Timeline orXSheet%

How to create a XSheet laer

Let0s now open a new pro+ect and come ack to the Timeline ta :7ou already know how to create an ma&eor an#nimation layer. Preating an(S)eetlayercan edone using the same way" using the Newpopup menu o! your Timeline or using the Layermainmenu.

R

At this state" the 'ename/ Duplicate/ Delete/ Copy/ 0ide and other classic options o! the so!twareare still availale. 5ut you certainly noticed that you can0t shrink or stretch this new layer. There are

no thumnail icons too.

The ' and ( uttons o! the XSheet ta can also e used tocreate or delete a XSheet layer.

The letter J X K indicates that the column represents an XSheetlayer.

Managing the content o! an image o! the XSheet layer or managing the position in time o! itsimages have to e done in the(S)eet panel.

#nce your XSheet layer is created" you have to speci!y in the XSheet ta one or more sources.

#therwise" it will not e possile to use it" ecause you cant draw on a XSheet layer. The imageso! the chosen sources will constitute the elements o! the(S)eetlayer.

-N Sound and XSheet


13/23


How to create and manage the sources

The source management can e done in the right part o! the(S)eetpanel.In order to add a source column" you have to use the (' src) utton encircled elow.

The ()src) utton allows to remove a source column !rom the right part o! the XSheet ta.

The choice o! a source !or your column can

e easily done thanks to the popup menulocated at the ottom right o! the XSheet ta.

7our source can e :

, an animation layer in the current pro+ect

, another open pro+ect

, a seDuence

Its also possile to change the names o!

your source layers" !or a etter readaility.7ou only have to use the popup menu nameopposite.

I! the Layer Typeis selected" a menu Layerwill allow you to choose whichone you want as source. $see opposite%Same ehavior with the Project Typeselected.Image layers are not availale as source.

The width o! oth sides o! the XSheet ta can e ad+usted y dragging the middleseparator. The thumnails options and the position o! the separator are also savedwith your pro+ect.

;o not con!use the source columns on the right part o! the XSheet ta and thelayers columns on the le!t part o! the XSheet ta. The source columns are used tomanage the content o! the XSheet layers and are not visile in the timeline whereas

the layers columns are also visile in the timeline. $see elow%

Some e'planations aout the Se1uence source option. As seen previously" a source !or theXSheet Layers can e an open pro+ect or one o! the layers o! the current pro+ect. The Se1uencesource allows to choose an e'ternal !ile $all the supported !ormats in TBCaintAnimation Cro!essional dition are availale% and use it as a source.

Sound and XSheet -N4


14/23


A concrete e*ample

I! you have !ollowed this lesson !rom the eginning" you should have two pro+ects on the TBCaintAnimation Cro screen. The pro+ect 'unnin&*2id.tvpand a new pro+ect called 3ntilted*45containingan XSheet layer.

Cro+ect called 3ntilted*45we added the 'unnin&*2id image seDuenceas source" as shown elow.

/ow we only have to add some images !rom our source into the XSheet layer.

2ere again" the thum utton allows to swap etween the XSheet display and thethumnails display.

I! you selected a (clip) as source" its layers are considered as i! they were merged.

How to manage the content of a XSheet laer

1e are now going to modi!y the content o! our XSheet layer., 5e!ore eginning" you must know that it is possile to stretch a XSheet layer y doing a drag0ndrop at one o! its e'tremities. So you can otain several cells" as shown ne't page., A!ter this operation" you have to enter in the cells the re!erences !rom a source image.To do so" you have to use the !ollowing synta' : Source +olumn , Source Line$The cells containing the character J ) K doesn0t have any re!erence.%, The cells manually !illed have their re!erence image written in lack.

, 5y de!ault" all the cells !ollowing a manually !illed cell are written in pink color and have the same

re!erence image. Those images are also called key!rames., #nce !inished" each cell !rom the XSheet layer correspond to an image chosen into the Sourcecolumns. $For a etter readaility" you can use the thumnail view in order to replace each cells yits corresponding image%

-N9 Sound and XSheet


15/23


#pposite" here is how to stretch an XSheetlayer.

#pposite :

, The !irst three cells o! the e'position layer areempty.

, The !ourth cell o! the XSheet layer is the E th

image !rom the source column called 2id.

, The !our last cells have the same re!erence asthe !ourth cell.

-ith thum$nails -ithout thum$nails

XSheet Laer with its cells Source images and columns

I! you selected an open pro+ect as source" the source pro+ect will e stretched to !itthe XSheet layer.

In order to !ill in the cells o! an XSheet layer $in other words" to add images in aXSheet layer%" you can also dragn drop thumnails and cells !rom the source

columns into a XSheet layer.

It is also possile de manage Xsheet layers !rom the Clip : Timelineta. Plick on the handles andstretch your layer" in order to make it longer or shorter.

7ou can also manage sources easily in the Clip : Timelineta. &ust doule click on a tween in

order to rename it. 2ere" enter the source name $!or e'ample" Hid:NE% in order to use the NEth

image !rom the 2idsource $o! course" a source has to e loaded in the Clip : (s)eet%.

Sound and XSheet -N


16/23


&

#! course" i! you enter a name that does not re!er to a source" you will otain an empty image.

Select and move several images in a XSheet laer.

7ou can also select your images !rom the Clip : Timeline ta. I! you hold this selection and move it

to an anim layer" the e'posures cells will e turn into instances :

-NE Sound and XSheet

I! you want to select several images in a XSheet layer" hold the >shi!t?key down and do a drag0n drop with the LM5 on the cells orthumnails o! the XSheet layer.


17/23


The icons of the XSheet ta$

ach icon elow has a speci!ic action regarding the XSheet layer or the XSheet ta. 1e will nowe'plain each o! them separately in the ne't page.

Sound and XSheet -NG

This utton allows you to shu!!le the selected images o! a XSheet layer.

This utton allows you to cut the selected images cells !rom a XSheet layer.

This utton allows you to copy the selected images cells. It can e either source imagesor images cells !rom a XSheet layer.

This utton allows you to paste the cut or copied images cells !rom a XSheet layer intoe'isting images cells. This action deletes the selected images and insert the new ones.

This utton creates a new XSheet Layer.

This utton deletes the current XSheet Layer.

This utton toggle the thumnails cells view.$A right click on it opens a popup menu with several options%

For a etter readaility" the icon opposite allows to display hide the columns o! the imageand animation layers in the XSheet panel.This option is only working with the XSheet ta and does not interact with the timeline orthe pro+ect display.

This utton allows you to add a source into the XSheet ta.

This utton allows you to delete a source !rom the XSheet ta.

This utton allows you to add one tween to each selected !rames.

This utton allows you to delete one tween !rom each selected !rames.

This utton allows you to add multiple tweens to each selected !rames. A popup menu willappear to set the numer o! tweens to add.

This utton allows you to delete multiple tweens !rom each selected !rame. A popup menuwill appear to set the numer o! tweens to delete.

This utton allows you to invert the order o! the selected !rames.


18/23


7ou can also use :the LM5 and drag to J move K $cut and paste% a selected range o! !rame.Ptrl LM5 to J move K $copy and paste% a selected range o! !rame

2ere is a small summary diagram :

The options that allows to cut" copy" or paste the cells can e applied !rom anXSheet layer into itsel! or into another one. $however" it is not possile to cutsource images%

Select a default source

1hen you click on the name o! your XSheet layer" a popupmenu called de!ault source appears at the ottom o! theXSheet ta.It is then possile to assign a source column y de!ault toyour XSheet layer : all the re!erences o! the cells will onlyneed a numer o! picture in order to e taken into account.

This is very convenient to create new XSheet layerssynchronised with the current one.

7ou only have to duplicate the current XSheet layer andchange the de!ault source o! the duplicated XSheet layers.

A$out the projects

1hen a pro+ect needs some images to e repeated several times" its advised to use XSheetlayers. It allows to decrease the si3e o! the pro+ect when you save it on your hard drive" ecauseeach repeated image is saved only one time.

1hen you save a pro+ect in TBC Animation Cro!essional dition" the relatedXSheet ta and layers are saved too. $7our pro+ect will still e availale usale

with previous so!twares !rom TBCaint. 5ut" the XSheet and sound Duotes layerswill not e viewale nor usale.%

-N Sound and XSheet


19/23

The steps to create a lip-sync

The steps to create a lip)snc

In this section" we will learn how to synchroni3e the !acialmovements o! a character $especially his mouth% with a preloadedaudio track.

The main idea is o! course to give the impression that the wordscome !rom our animated character and not !rom a recording thathas een added over an animated seDuence.

The pro+ect Lipsync.tvpand the audio track voice.mp6will e taken as a asis to study the lipsyncsteps. 7ou can !ind them on the so!tware P; @#M. Those who downloaded the evaluation versiono! TBCaint Animation Cro can !ind those !iles in the (content sharing) section o! our online !orum.$http:www.tvpaint.com!orum%

2ere is the timeline o! the pro+ect Lipsync.tvp

Layer (eyes)

Layer (pupils)

Layer (rows)

Layer (!ace hair)

Layer (hair color)

Layer (mouth 9)

Layer (mouth 4)

Layer (mouth )

Layer (mouth N)

Layer (+aw)

Layer (!ace-color)

Sound and XSheet -N*
http://www.tvpaint.com/forumhttp://www.tvpaint.com/forum


20/23


1e have chosen the !ollowing colors to have a etter readaility through the timeline:-the layers relative to the mouth movements are in red.-the layers relative to the +aw and !ace are in lue.-the layers relative to the eyes movements are in purple.

I! you play now this pro+ect" the result will not e really interesting. 5ut we will Duickly remedy thissituation.

+ali$rate the options relative to the audio track

/ow that the pro+ect is loaded in TBCaint Animation Cro" lets import the audio track namedvoice.mp4.

#nce your audio track is loaded:, 5egin y setting the o!!set parameter with accuracy, Lock your audio track in order to prevent unwanted changes, Select (scru) or (always) as parameter !or the audio +og" with a duration o! or 4 seconds. $see!irst chapter !or more details%

The option called: )nter audio scru duration) allows you to speci!y the durationo! the sound that you will hear a!ter each movement throughout the timeline.$This option is !unctional only i! the (+og audio) parameter is not in (none) mode.%

At this point in the process" your movements throughout the timeline should e !ollowed y one orseveral sounds.

!ositioning slla$les and phonemes

It is now advised to display the XSheet panel in order to continue our work. $Although all thecoming steps can e done directly in the timeline.%

1hen you move your cursor $ie: change the current image% through the timeline" try to !indsyllales and phonemes.

Then" add an annotation on the corresponding place. To do so" use the option Notes whichappears in the audio track conte'tual menu or in the ma&esmain menu.

-O Sound and XSheet


21/23


7ou should otain a XSheet panel like the one elow :

I! the te't that you want tosynchroni3e with your character islong" try to add ookmarks to the

images !rom which a syllale or phoneme

starts. It will e easier to !ind again thoseimages later.

7ou can already hide the animationlayers. Those layers will not evisile when the pro+ect will e

!inished.

They are only here in order to e selectedas source !or the XSheet layers.

2owever" you can set )old as post-ehavior !or the Image layers. $they willstay visile until the end o! the lip sync

process%7ou should otain the image elow :

+reate some source columns

As e'plained on page " you have now to set your sources images and columns in the right part o!the XSheet ta. 2ere elow" the source columns are created !rom the e'isting animation layers o!our pro+ect. $the column !coloris linked to the layer !ace color%

Sound and XSheet -N


22/23


+reate some XSheet laers

/ow" let0s create some XSheet layers.

For each sound o! the audio track" the +aw and the !ace skin should move accordingly" as ourcharacter is talking. $see elow%

& & &

The movement o! thecharacter0s +aw

& & &

The movement o! the!ace0s skin

Two synchronised XSheet layers will e needed here to do the +o. #nly their de!ault sourcecolumn will e di!!erent. $!color and +aw%

ach sound o! the audio track can e roken down into separated seDuences :

& & &

#pposite" the J # K sound

& & &

2ere the J A K sound

& & &

The J I K sound

& & &

The J K sound

ach time that the J # K J A K J I K or J K sound will e encountered on the timeline" you willthen have to reproduce the corresponding con!iguration.A XSheet layer derived !rom the two last descried XSheet layers will e used here. 2owever" itwill not have a de!ault source" ecause it will use the !our source columns $mouthN mouth mouth4

mouth9%

Finally" you will have to make the character link periodically in another XSheet Layer.

& & & &

The movement o! the rows will depend on the conte't o! the scene. It can e'press astonishment"neutrality" !atigue" etc ... It will also need an XSheet layer.

- Sound and XSheet


23/23


2ere is the result with the XSheet ta :

Lets assume that our character comes !rom an animated TB series. It will epossile to re-use the same images !or the !ace" XSheet layers constructed withthe method"QetcQ

- - - - - - - - - - -

7ou can always trans!orm an XSheet layer into an Animation layer with Instancesy using the Trans!orm into #nimation Layeroption $use the layer conte'tual menu

in the Timeline%.

tvpaint tutorial 8

Documents