gates cultural labor of surveillance

20
The cultural labor of surveillance: video forensics, computational objectivity, and the production of visual evidence Kelly Gates* Department of Communication, University of California, San Diego, CA, USA (Received 14 March 2012; final version received 31 August 2012) This essay argues that the status of video evidence as an index of real events*a sign or representation that offers a direct, empirical connection to material reality*is the result of an intentional process of production. This process involves the repurposing of new technologies borrowed from the domain of creative media production in order to transform a chaotic field of raw surveillance video into useable evidence. In addition to the exchange in technologies, an unavoidable epistemological and interpretive exchange takes place between evidentiary uses of surveillance video on the one hand, and the now prevalent forms of surveillant narration found in both fictional and reality-based storytelling. But despite this exchange in meanings and technical systems, considerable effort has gone in to establish formal standards for the evidentiary uses of surveillance video that distinguish the discovery of video evidence from the production of creative content. Building on Daston and Gallison’s historical study of the prevailing ‘‘epistemic virtues’’ that have defined objectivityover time, I argue that what we see emerging in the field of forensic video analysis, as a means of establishing its scientific and legal status, is a commitment to a new epistemic virtue of ‘‘computational objectivity.’’ Keywords: surveillance; surveillant narration; police technology; police media; police work; forensic video analysis; visual evidence; computational objectivity A photo of two of the alleged 9/11 hijackers passing through airport security in Portland, Maine, on the morning of the attacks appeared in 1 October 2001 issue of TIME magazine. Another photograph, allegedlydepicting three of the London subway bombers on a trial run before they carried out the attacks on 7 July 2005, was published in The New York Times two and a half months after the bombings. The surveillance stills from these high-profile incidents are accompanied by thousands of other more banal examples, often depicting events that make the news not so much because of their world-historical importance but because surveillance cameras fortuitously recorded the ‘‘money shot.’’ For example, the abduction and murder of Carlie Brucia by a drug addict named Joseph Smith in Sarasota, Florida, on 1 February 2004 received national attention in no small part because a gas station security camera happened to capture Smith approaching the 11-year-old girl and leading her away. A still shot taken from the video, showing Smith’s hand clasped around the child’s extended arm, circulatedwidely in the press. It was the decisive evidence that led to his conviction, both in criminal court and in the court of public opinion. *Email: [email protected] Social Semiotics, 2013 Vol. 23, No. 2, 242260, http://dx.doi.org/10.1080/10350330.2013.777593 # 2013 Taylor & Francis

Upload: blythe-tom

Post on 12-Dec-2015

214 views

Category:

Documents


1 download

DESCRIPTION

Surveillance Foucault

TRANSCRIPT

Page 1: Gates Cultural Labor of Surveillance

The cultural labor of surveillance: video forensics, computationalobjectivity, and the production of visual evidence

Kelly Gates*

Department of Communication, University of California, San Diego, CA, USA

(Received 14 March 2012; final version received 31 August 2012)

This essay argues that the status of video evidence as an index of real events*asign or representation that offers a direct, empirical connection to materialreality*is the result of an intentional process of production. This process involvesthe repurposing of new technologies borrowed from the domain of creative mediaproduction in order to transform a chaotic field of raw surveillance video intouseable evidence. In addition to the exchange in technologies, an unavoidableepistemological and interpretive exchange takes place between evidentiary uses ofsurveillance video on the one hand, and the now prevalent forms of surveillantnarration found in both fictional and reality-based storytelling. But despite thisexchange in meanings and technical systems, considerable effort has gone in toestablish formal standards for the evidentiary uses of surveillance video thatdistinguish the discovery of video evidence from the production of creativecontent. Building on Daston and Gallison’s historical study of the prevailing‘‘epistemic virtues’’ that have defined objectivity over time, I argue that what wesee emerging in the field of forensic video analysis, as a means of establishing itsscientific and legal status, is a commitment to a new epistemic virtue of‘‘computational objectivity.’’

Keywords: surveillance; surveillant narration; police technology; police media;police work; forensic video analysis; visual evidence; computational objectivity

A photo of two of the alleged 9/11 hijackers passing through airport security in

Portland, Maine, on the morning of the attacks appeared in 1 October 2001 issue of

TIME magazine. Another photograph, allegedly depicting three of the London subway

bombers on a trial run before they carried out the attacks on 7 July 2005, was published

in The New York Times two and a half months after the bombings. The surveillance

stills from these high-profile incidents are accompanied by thousands of other more

banal examples, often depicting events that make the news not so much because of their

world-historical importance but because surveillance cameras fortuitously recorded

the ‘‘money shot.’’ For example, the abduction and murder of Carlie Brucia by a drug

addict named Joseph Smith in Sarasota, Florida, on 1 February 2004 received national

attention in no small part because a gas station security camera happened to capture

Smith approaching the 11-year-old girl and leading her away. A still shot taken from the

video, showing Smith’s hand clasped around the child’s extended arm, circulatedwidely

in the press. It was the decisive evidence that led to his conviction, both in criminal court

and in the court of public opinion.

*Email: [email protected]

Social Semiotics, 2013

Vol. 23, No. 2, 242�260, http://dx.doi.org/10.1080/10350330.2013.777593

# 2013 Taylor & Francis

Page 2: Gates Cultural Labor of Surveillance

Images like these are readily recognizable as still shots captured from surveillance

video � the perspective, usually shot slightly from above and at an angle, a banal

location, a grainy or blurry quality, and often a time�date stamp and a camera

number imprinted on the image. When reproduced as press photos, the images

typically include an image credit printed in tiny type below the photo. In the London

subway photo, it read ‘‘Metropolitan Police, via Associated Press,’’ (Lyall, 2005)

suggesting both a path of information flow and an institutional relationship. This

and other contextualizing metadata (the caption, the headline, and the text of article)

assign specific meaning to these images, but the meanings of their visual content

alone are often radically indeterminate. Nothing in these photographs themselves

can definitively identify the people depicted, for example. Surveillance images can be

of fairly poor quality, and it can be difficult to see people’s faces. If facial recognition

technology had been installed with the surveillance systems that captured these

images, it is unlikely that it would have matched the faces with accurate identities

since the technology does not work well in uncontrolled settings like the ones shown.

In raising questions about these kinds of images, it is not my intention to

introduce conspiracy theories or challenge the evidence presented in any particular

case. Instead, I want to call attention to the amount of work that goes into

establishing the credibility of these images and others like them � the discourses,

procedures, technologies, and forms of labor that work to define the images as

authoritative proof. There is nothing new about calling attention to the indetermi-

nacy of images or the fact that there are intentions embedded in their production, but

these points need re-emphasizing with respect to surveillance images. Despite their

low quality, images derived from surveillance video work well as press photos or as

visual evidence of real events in other contexts, such as courtrooms. Their lack of

clarity should make their indeterminacy more apparent but it also works, in a

contradictory fashion, to lend them some measure of credibility. Images like these

have a grainy, seemingly unproduced claim-to-authenticity � an ‘‘aesthetics of

objectivity.’’1 These images are metonyms of video surveillance, invoking the real-

time visual mediation of real events. When they depict something of interest, they not

only represent that event but also the fact that it was caught, ‘‘live,’’ on camera. But

despite their seemingly ‘‘raw’’ quality, considerable work goes into producing these

images, into choosing ‘‘the perfect moment’’ as well as clarifying the image and

making relevant details visible. The surveillance images that circulate as press photos

are not untouched real-time images, but they gain authority and credibility by

invoking a sense of real-time surveillance.

Even when individuals are captured on camera in the act of committing crimes,

their identification, prosecution, and conviction typically requires additional

evidence � for example, matching clothing on a person depicted in a video with

clothing on a person who was physically apprehended. Still, the fact that people

committing crimes are sometimes ‘‘captured’’ on camera is significant. A still from a

surveillance video, circulated in the press, not only makes an evidentiary statement

but it also allows a symbolic form of passive public participation in the investigation.

Readers are invited to take the perspective of surveillance workers, observing the

real-time surveillance feeds, to literally see the scene through the surveillant police

gaze. There is an implicit degree of pleasure and a presumption of empowerment in

this act of looking at the surveillance image and identifying the suspects. Gazing at

Social Semiotics 243

Page 3: Gates Cultural Labor of Surveillance

the image, readers are hailed into place as pseudo-investigators scanning recorded

video for trace evidence of crimes.

In his history of police photography, John Tagg (1988) notes that crime reporting

was part of the manufacture of the criminal threat that provided an alibi for the

professionalization of the police forces in the UK in the nineteenth century. Today,

with a professional law enforcement apparatus fully institutionalized in all developedcountries, crime reporting continues to serve a legitimizing function for the police.

But rather than establishing the professional police force as a social necessity, which

is no longer considered a reasonable question, crime reporting (and crime drama)

works to legitimize policing strategies and adoption of new technologies. Each time a

surveillance camera image circulates in the press, it does double duty, representing

the event in question while at the same time justifying police deployments of video

surveillance systems.

The 1980s and 1990s saw an exponential increase in the use of closed-circuit

television (CCTV) systems by police and private security companies for monitoring

urban areas, workplaces, retail outlets, banks, casinos, roadways, airports, and other

settings. The UK is often identified as having the most CCTV coverage, but the

United States also has seen a patchwork proliferation of cameras and networks, with

a combination of public and privately owned CCTV systems now covering large

areas of most major cities. The vastly increased use of CCTV for monitoring public

and private spaces over the last several decades has spurred efforts to ‘‘optimize’’these systems � to make them function more effectively as technologies of crime

control as well as technologies of proof.

In this paper, I consider the emerging field of video forensics as one technology of

CCTV optimization. The work of video forensics includes the production of images

like the ones described above, but it is not limited to the production of press photos.

Video forensics involves the postcrime analysis of surveillance video as part of

criminal and other types of investigations. It also involves the archival management

of recorded surveillance video, as well as the preparation of video evidence for

presentation to an audience, whether in courtrooms or other settings.2 Although

I primarily focus on the United States context, the emerging technologies and

practices discussed here are not exclusive to the United States, and the questions

raised by the evidentiary uses of surveillance images have broad relevance for other

national contexts.

On the surface, the status and usefulness of surveillance video as evidence in

criminal and other types of investigations would seem self-evident. However, whenconsidering more closely what happens in the process of locating video of interest

and analyzing, organizing, and using that video in criminal investigations, it is clear

that a significant amount of work goes into transforming recorded surveillance video

into usable evidence. In other words, surveillance video in itself has little or no

evidentiary value; video evidence must be produced from a chaotic field of raw

surveillance footage. The status of video evidence as an index of real events � a sign

or representation that offers a direct, empirical connection to material reality � is the

result of an intentional process of production, a process that requires new forms of

technical expertise and police work, as well as the adaption of new technologies

borrowed from the world of creative media production. The emerging field of

forensic video analysis is one site where an epistemic virtue of ‘‘computational

objectivity’’ is taking shape: the belief that neutral scientific image analysis can be

244 K. Gates

Page 4: Gates Cultural Labor of Surveillance

achieved by translating certain forms of professional trained judgment into

computational processes or, in this case, through the application of computational

techniques by police professionals retrained as video specialists. I also suggest that,

regardless of how important the virtue of objectivity is to forensic video analysis andthe production of visual evidence, there is no avoiding the exchange in technologies,

practices, and meanings that takes place between the official domains of investigative

practice on the one hand, and the less official domains of surveillant narration found

in film, television, and new media.

The cultural labor of surveillance

In Christopher Wilson’s (2000) cultural history of policing, he examines the narrativeauthority that police held in the United States throughout the twentieth century �how dominant ideas, values, and assumptions about crime and policing circulated

back and forth from police policy and practice to crime reporting and the popular

genres of crime fiction and True Crime storytelling. As Wilson argues, police power

is derived to a significant extent from their narrative authority or their ability to tell

authoritative stories about crime and about their own proper role as agents of the

state and as arbiters of law and order. In light of this analysis, it would seem that

police authority is negotiated in part through the cultural forms of labor that policeofficers perform � not so much ‘‘fighting crime’’ directly but performing their roles

(sometimes for the cameras) and employing media technologies and tactics in a

constant battle of interpretations about crime, social disorder, and the limits and

extent of police power. While struggles over legitimacy and authority have been

fundamental to modern police institutions since their inception, what is changing

today are the platforms, technologies, and tactics on and through which these battles

play out, and the forms of labor required to make effective use of the evolving

technological and tactical playing field.

In a study of the institutional structure of police work conducted in the 1990s,

Richard Ericson and Kevin Haggerty (1997) found that the police did not spend the

bulk of their time ‘‘fighting crime,’’ as portrayed in media crime dramas, but, instead,

on administrative matters or ‘‘knowledge work.’’ For this reason, they argued, the

police are best understood as knowledge workers within risk management systems:

law enforcement officers perform the labor of collecting and processing information

by and large to support the risk management needs of other institutions, such as the

insurance industry. Institutional demands for knowledge of risks have led to the riseof a risk-communication system of policing, which now largely determines what the

bulk of police work actually involves. In particular, the data burden this system

generates leads police organizations to constantly search for new technology-based

solutions to manage the flow of information, solutions which themselves often

generate ever more data. This cycle of technology adoption combined with ever-

expanding data-processing requirements characterizes police efforts to manage and

optimize video surveillance systems.

Where Ericson and Haggerty argue that the police face external institutionalforces and constraints that shape their work in ways over which they have little

control, Christopher Wilson sees the police as somewhat more autonomous

producers and promoters of ‘‘cop knowledge’’ or police-oriented epistemologies

that hold considerable sway in narrating forms of social understanding. Even beyond

Social Semiotics 245

Page 5: Gates Cultural Labor of Surveillance

their formal roles as generators and managers of data, or as ‘‘sources for crime

reporters, consultants for television shows and films or informants for criminologists

or sociologists,’’ the police provide ‘‘the first drafts of a great deal of our cultural

knowledge about social disorder and criminality’’ (Wilson 2000, 6). For Wilson, the

police dominate the terms of the debate about crime and social order across a broad

cultural and political field, exercising a form of narrative power that is especially

consequential in portraying and making sense of the everyday experience of the poorand marginalized groups. When the police feed the information economy by

engaging in the work of generating data on criminal activities and security risks,

they are not only just responding to external pressures but also exerting considerable

influence on the way stories are told about crime and police power beyond the legal

domain.

When considering the types of ‘‘new media work’’ that the police perform today,

what is clear is that the respective roles of the police as generators of data and

producers of culture are not mutually exclusive. To understand the relationship

between these two indistinct responsibilities of modern police, it helps to understand

the ways in which at least some of the work that police do today can be characterized

as cultural or ‘‘immaterial labor.’’3 The concept of immaterial labor is typically

associated with the culture industries and, more recently, with the forms of (often

unpaid) labor that armies of Internet users perform in the service of building and

maintaining the World Wide Web. In this latter formulation, immaterial labor

supports major capitalists endeavors like Facebook, Google, and YouTube, as well asthe vast field of lesser websites and services that populate the online world. But

immaterial labor is not limited to the leisure-work performed by Internet users. ‘‘As a

collective quality of the labor force,’’ writes Tiziana Terranova (2000), ‘‘immaterial

labor can be understood to pervade the social body with different degrees of

intensity’’ (42).

What is conceptually understood as immaterial labor pervades police work,

especially insofar as ‘‘the skills involved . . .are increasingly skills involving cyber-

netics and computer control’’ (Lazzarato 1996). The police engage in forms of

cybernetic labor as they perform myriad responsibilities on the job: entering and

accessing information, using database interfaces at computer terminals in police cars

and in police stations, using handheld digital devices to identify suspects (e.g., mobile

biometric devices that attach to iPhones), or searching the Internet to do

investigative work (e.g., using Facebook to identify faces of otherwise anonymous

people captured in surveillance video). When police video analysts use video

forensics systems to analyze and manage surveillance video, they are engaged in

producing informational content and developing and enacting skills involvingcybernetics and computer control. This type of immaterial labor involves a

considerable amount of mental and perceptual work, or work that involves cognitive

rather than physical activities.4

It is also the case that certain forms of police work produce the cultural content

of commodities and involve ‘‘a series of activities that are not normally recognized

as work’’ � and certainly not police work � such as ‘‘defining and fixing cultural

and artistic standards, fashions, tastes, consumer norms, and . . .public opinion’’

(Lazzarato). When the police are performing for the camera, for example, in the

manner of the ubiquitous reality-based cops show (like COPS), they are engaged in

the work of cultural production.5 They may be literally engaged in the work of

246 K. Gates

Page 6: Gates Cultural Labor of Surveillance

‘‘fighting crime,’’ but they are simultaneously performing a kind of cultural labor,

doing their part in the production of cultural commodities that have value as

entertainment, while also defining a certain cultural image of policing and law and

order. Police are often tasked with performing the role of the police in society for the

cameras.

When police and other law enforcement personnel do the work of sifting through

surveillance camera footage to find content of interest that in turn becomes com-

mercial media product; they are also performing cultural or ‘‘immaterial’’ labor � doing

the work necessary to provide material to feed the voracious media appetite for

reality-based content. But even when this media content remains within the domain

of police investigations and criminal prosecutions, it shares important affinities with

entertainment or infotainment media. An aesthetics of surveillant media circulates

back and forth from the official domain of policing to the less-official domains of

popular and online social media. We are now accustomed to encountering

surveillance-style images whether we are watching the news, YouTube, or fictional

crime dramas.

In other words, while it is important to consider the evolving forms of new media

work that the police engage in today, it is also important to consider a parallel

development: the use of surveillant forms of narration in a wide range of cultural

forms, both factual and fictional. In fact, it is difficult to draw a clear distinction

between the uses of surveillant narration in real versus fictional storytelling. On the

one hand, surveillance video lends dramatic weight to court proceedings, news

stories, and reality-based programs. On the other hand, a visual rhetoric of

surveillance is now commonplace in fictional drama, typically used to invest the

story with a high level of realism or to convey information about the temporal

dimensions of the story, such as using a recorded surveillance video as a form of

flashback or to show two scenes happening simultaneously. The symbiotic relation-

ship between the uses of a surveillant mode of visual address to represent both reality

and realist fiction cannot help but encourage a similar sort of interpretive exchange

at the level of reception among audiences. As Nick Groombridge (2002) puts it, the

‘‘separation between the rational/bureaucratic elements of CCTV and the affective/

aesthetic/entertainment [aspects] can no longer be sustained’’ (37).In film studies, Thomas Levin (2002) has analyzed precisely this use of

‘‘surveillant narration’’ as a technique of cinematic realism. He sees an increasing

tendency in cinema to treat surveillance not only as a thematic concern but also as

part of the structure of cinematic narration itself. Levin argues that the growing

prevalence of surveillance in cinema, as both theme and narrative structure, is a

response to the crisis of photographic referentiality brought on by digital imaging

techniques. In short, digital techniques may have undermined photography’s claim to

the real, but there are new kinds of truth claims being made with visual media,

especially with surveillance images, which invoke real-time, ‘‘unproduced’’ access to

the action. Levin theorizes the rhetorical force of surveillance images by emphasizing

the temporal dimension of their indexical function6:

the spatial indexicality that governed the earlier photographic condition has been replacedby a temporal indexicality, an image whose truth is supposedly ‘guaranteed’ by the fact thatit is happening in so-called ‘real time’ and thus � by virtue of its technical conditionsof production � is supposedly not susceptible to post-production manipulation.

Social Semiotics 247

Page 7: Gates Cultural Labor of Surveillance

The fundamentally indexical rhetoric of cinema’s pre-digital photo-chemical past thussurvives in the digital age, albeit now re-cast in the form of the temporal indexicality of thereal-time surveillant image. (592)

Every surveillance image-whether video or still shot, ‘‘live’’ or recorded, staged or

unstaged-carries with it an implicit rhetorical claim of temporal indexicality. Even

though recorded surveillance video does not depict events as they are happening in

real time, it nonetheless invokes a sense of temporal indexicality. Recorded video

surveillance makes time searchable, albeit within spatial limitations, enabling a form

of reality-rewind or ‘‘playback.’’ Photography has always invoked a sense of

connectedness to the past, but recorded video surveillance adds another dimension

to this connectedness � not a symbolic visual link to lost loved ones or historic

events, but a replay that appears to give viewers direct access to specific segments of

time.

Cinema’s use of surveillant narration as a form of realism has its inverse in the

techniques that forensic video analysts are developing to process and analyze

surveillance video. Video forensic techniques enable their users to make authoritative

claims about the indexicality of surveillance images,7 helping video analysts

transform a chaotic and meaningless field of recorded vision into coherent and

direct references to real people, places, objects, and events. But much like with

cinema, a significant amount of production labor goes into transforming surveillance

video into evidence and ensuring that images maintain a seemingly ‘‘unproduced’’

quality. Concerns about lighting conditions, placement of cameras, camera angles

and movement are not alien to users of video surveillance systems. These users are

also becoming acquainted with editing and postproduction techniques, adapting

them to the needs of visual evidence production.

Video forensics and the production of image indexicality

One of the leading video forensics systems used by law enforcement in the United

States is a system designed and marketed by two companies in partnership: Avid and

Ocean Systems. Ocean Systems is a small, private IT company that designs and

markets a suite of software called ‘‘dTective.’’ (Other commercially available systems

include Cognitech’s ‘‘Video Investigator,’’ Salient Stills’ ‘‘VideoFocus,’’ and StarWit-

ness’s ‘‘TechAgent.’’) The dTective system uses as its underlying architecture

powerful media management systems designed and marketed by Avid � a much

larger, publicly traded company that produces the industry standard in digital

nonlinear editing systems. Avid’s promotional language and product descriptions

emphasize the creative and profitable potential of their technologies. According to its

website, Avid technologies are used by filmmakers, broadcasters, recording engineers,

game developers, effects artists, and other media professionals to ‘‘make, manage,

and move media � more creatively, more productively, and more profitably.’’8 Ocean

Systems, on the other hand, suggests on its website that its products help customers

‘‘get to the truth’’ and ‘‘unlock hidden details’’ in video.9 Rather than promoting

the profitable potential of its products, the company promises to ‘‘provide you with

the right professional mix that meets your specific needs and budget’’ (Ocean

Systems n.d.a).

248 K. Gates

Page 8: Gates Cultural Labor of Surveillance

Promotional material for video forensic systems is especially important because it

is here where developers negotiate the meaning of the technologies, provide a

language for how to think about them, and attempt to establish their legitimacy as

investigative tools. And it is where developers distinguish video forensics technol-

ogies, however, implicitly, from their counterparts in the creative industries. The

distinctions that these companies make between the creative and forensic applica-

tions of video editing and media management systems should not obscure thesymbiotic relationship between these different applications, however. Technologies

borrowed from the world of high-tech creative production promise to help

investigators address the major limitations and problems they have faced in their

efforts to optimize the effectiveness of video surveillance systems and exploit their

evidentiary potential.

Problems with image quality are most familiar for visual evidence, in part because

writers and producers of film and television crime dramas often use the clarification

and enhancement of surveillance images as a narrative device. In these common,

dramatic depictions, fictional investigators use sophisticated computer programs to

enhance images and bring out hidden details that turn out to be pivotal pieces of

evidence and key elements in plot development. These sorts of fictional depictions

serve as another form of marketing and promotion for video forensics technologies

and often exaggerate their real capabilities. More than one observer has noted that

film and television crime dramas have created what is now known as the ‘‘CSI effect,’’

named after the popular CBS television show CSI: Crime Scene Investigation.10 Inshort, legal observers fear that real juries now expect to be treated to dramatic

evidence discovered by highly skilled expert investigators armed with high-tech

forensics systems � a problem for the justice system since in reality forensic evidence

tends to be much more banal and can often be more ambiguous in its implications

for any particular case.

Fictional depictions of video forensics may or may not create a ‘‘CSI effect,’’

leading to unreasonable expectations about what can be accomplished with digital

imaging techniques and visual evidence. Regardless, these dramatic portrayals should

not be dismissed as simply misleading, nor should concern focus narrowly on their

impact on juries. Instead, cinematic and televisual depictions of forensic video

analysis point to the epistemic and interpretive exchanges that take place between

police narrative strategies and the broader domain of cultural production about

crime, social disorder, and police power. While there is certainly legitimate concern

for the impact of media representations on juries, focusing narrowly on this question

invariably leads to the inadequate ‘‘limited effects’’ conclusion (i.e., the conclusion

that people are directly impacted by exposure to media representations only to alimited extent). Again, I want to suggest that there are productive insights to be

gained by considering the relationship between the real-life products of forensic

video analysis and more popular forms of surveillant narration (whether fictional or

‘‘reality-based’’).

If make-believe surveillance video poses a challenge for the fictional detectives

who populate film and television crime dramas, real-life surveillance video also

presents major image quality issues for flesh-and-blood investigators. A considerable

amount of production work is required to transform recorded surveillance video into

evidence in part because the video itself is typically of very poor quality. It is often

unusable and indecipherable in its ‘‘raw’’ state. If magnetic videotapes are used, as

Social Semiotics 249

Page 9: Gates Cultural Labor of Surveillance

they still are in some cases, they are often degraded from repeated use. Digital video

can take up considerable memory and often has to be compressed for processing and

storage. Compression rates can be set too high, leading to low-quality images,

deleted frames, and loss of other important visual information. Other image quality

problems derive from the physical context of surveillance systems. For example,

lighting can be bad (especially in video taken outdoors at night) making faces, license

plates, and other objects difficult to see. System design (or lack thereof) can alsointroduce problems � e.g., cameras are often stationary or poorly placed, resulting in

bad camera angles. Or, if the cameras are being manned (either handheld or remotely

controlled), there can be too much movement, creating unstable images and making

details difficult to see.

Ocean Systems’ dTective software, powered by Avid technology, is designed to

address these and other problems of image quality, providing users with a set of tools

they can apply to surveillance video images in order to produce usable evidence,

direct attention to specific objects or signifiers in images, and achieve an aesthetics of

objectivity. One software filter, called SpotLight, is designed to allow users to

highlight or obscure details in an image, drawing viewers’ attention toward specific

objects of interest and away from others. Similarly, the MAGNIFi filter can be used

to enlarge, track, or stabilize objects in images to make them more visible to viewers.

Another filter, called dVeloper, is used to perform frame averaging, a technique that

can ‘‘clarify’’ images and ‘‘bring out hidden details’’ (as described at the Ocean

Systems website). Frame averaging essentially creates a composite or average image,using data from multiple frames, eliminating ‘‘noise’’ from the image or any artifact

that is in motion. For example, a license plate number or exact make and model of a

car may not be visible when watching a surveillance video in playback mode, but it is

sometimes possible to clarify small details, like numbers and letters, by stabilizing the

portion of the frames where the license plate or other detail appears, and then

applying a frame averaging filter. The surveillance images that are reproduced in the

press are typically the products of frame averaging. The photo of two hijackers

passing through airport security on the morning of 9/11 mentioned earlier, for

example, was produced with frame averaging, using data from seven different video

frames to bring out more detail.11 Similar imaging techniques were used by ABC

News to show ‘‘a pair of gashes or welts’’ on George Zimmerman’s head the night he

shot and killed teenager Trayvon Martin, marks that were initially not visible in a

surveillance video taken at the police station as he arrived that night.12

While these imaging techniques may in fact bring out more detail than would

otherwise be visible in images, forensic video analysis should not be understood

purely in terms of its capacity to increase visual acuity. It must also be understood interms of the extent to which forensic techniques facilitate the opposite aim of visual

opacity. At the very least, forensic analysts must make particular choices about what

visual information to focus on and what to ignore, informed by their own

professional trained judgment. The software functions are not simply technical

processes but, instead, require human perceptual labor and decision-making. With a

frame averaging filter like dVeloper, for example, users must select which frames to

average from a sequence of thousands of video frames � i.e., which frames will

produce the ‘‘money shot’’ or the most meaningful visual evidence to build a

narrative for the case. When still shots are created from an average of multiple video

frames, or when software filters are applied to specific segments of images to

250 K. Gates

Page 10: Gates Cultural Labor of Surveillance

highlight specific details, most of the recorded video is excluded or left opaque.

Software functions like SoptLight and MAGNIFi are designed to direct attention

toward certain visual signifiers deemed to have evidentiary relevance or meaning,

and away from others, enabling video analysts to construct preferred interpretations

of images.13 When ABC News aired their enhanced video of George Zimmerman

being brought into the police station, for example, they froze the video on an image

of Zimmerman from behind, using a highlighted circle to enhance the marks on hishead that were not visible in earlier footage. In this way, they directed viewers’

attention to the precise visual details deemed relevant to the story. The rest of the

image was darkened so that other visual information would not distract viewers’

from seeing the newly visible evidence and making the correct determination (i.e.,

that Trayvon Martin had inflicted the injuries on Zimmerman, thereby supporting

the police narrative of events and their decision not to charge him.

Video forensic techniques are designed to help analysts produce the indexicality

of surveillance video and to visually enhance its direct link to reality. Another way

this is done is by inserting on-screen case notes, called ‘‘locators,’’ directly on

recorded images. These locators enable investigators to annotate video images with

specific observations and keep track of a suspect’s activities throughout one or

multiple videos. Video analysts use locators to attach verbal text to images, allowing

them to associate keywords, identifiers, and narratives to surveillance footage. The

evidentiary meaning of the images is established in this process of attaching on-

screen text, which appears each time the images are retrieved.Attaching this metadata to video images (whether visible on the screen or inserted

in fields not visible on the video itself) also provides a means of searching and

retrieving specific video segments, using text-based keyword searches. Users can

search a video database for terms like ‘‘red jacket,’’ ‘‘forearm tattoo,’’ or

‘‘44 Magnum’’ to find images tagged with these identifiers. For example, in the

case of the 2011 Vancouver Stanley Cup riot investigation, which involved thousands

of hours of video from surveillance cameras and hand-held devices, tagging images in

this way has enabled investigators to identify suspects in multiple video images

gathered from different sources. Adding on-screen case notes provides a means of

effectively tracking the movements and behaviors of individuals on the night of the

riots, and in some cases, provides evidence of a single suspect involved in multiple

incidents.

Another method for producing image indexicality is a time-code plug-in feature,

which allows analysts to paste a time�date stamp onto a video if one does not already

appear on the image, or if the analyst determines that the time needs to be corrected.(There is, of course, no way of guaranteeing that the time and date programed into a

CCTV system is correct, or that it corresponds precisely to standard mean time.) The

banality of the digital clock imprinted on the image belies the importance of the

time�date stamp in providing an authoritative temporal indicator, visible to viewers.

The time�date stamp assigns precise timing to the event depicted, including both the

exact moment in the past when an event occurred as well as the amount of time that

elapsed as the event unfolded. The time-code plug-in feature allows the temporal

indexicality of surveillance images to be reverse-engineered, intentionally inserted

into video that would otherwise document an indefinite past moment of time.

The ability to insert a time�date stamp on a recorded video image after-the-fact

raises the question of time�date verification: how can the accuracy of the time and

Social Semiotics 251

Page 11: Gates Cultural Labor of Surveillance

date indicated on a video be authenticated? It also brings into sharp relief one way in

which the temporary indexicality of surveillance video images is produced. This is no

small issue given that the precise timing of events, and temporal discrepancies, can be

decisive variables in criminal cases. In fact, in some cases, the timing of events can bekey to establishing or failing to establish reasonable doubt about a suspect’s guilt.

Because CCTV systems are installed and maintained by a wide range of actors with

variable levels of technical expertise, the accuracy of time�date stamps that appear

on surveillance video images can vary widely. And while the accuracy of the seconds

field may be relevant only in a small number of cases, the possibility of

misrepresenting the minutes, hours, and even dates assigned to images raises

questions about precisely how the temporal indexicality of surveillance images is

established.

Computational objectivity

In descriptions of video forensic systems like dTective, one would be hard-pressed to

find evidence of William Mitchell’s (2001) argument that new digital technologies are

‘‘relentlessly destabilizing the old photographic orthodoxy’’ and subverting tradi-

tional notions of photographic truth (223). Instead, in these promotional descrip-

tions, we find an emphasis on the ways new digital techniques amplify the powers ofsurveillance and open up new dimensions of reality to observation. While digital

imaging techniques are commonly viewed as disrupting the relationship between

image and reality, the emergence of the field of forensic video analysis suggests that is

also important to consider how digital techniques are being applied to visual images

in order to reinforce their status as evidence of the real, to lay newly empowered

claims to the truth of visual media. If digital imaging techniques have introduced a

renewed challenge to the principle of photographic truth in the discourse of video

forensics, we also find a different set of promises associated with the digitization ofvisual media. Here computational analysis is deemed more objective and scientific

than predigital, analog forms of image analysis and enhancement. Once images are

digitized, in this view, the one and zeros become their underlying code, enabling a

more precise and detailed analysis of their content. When digitization is understood

and used as a means of precisely breaking down an image into its smallest

component parts, the status of the image as index of the real is intensified. In the case

of recorded video surveillance, digitizing the image is an attempt to digitize reality,

and digital enhancement techniques become a means of clarifying the real,sharpening its edges, and making important details more visible.14

Here I want to suggest that the use of digital imaging technologies to make visible

what is invisible and invest images with indexicality points to a new conceptualiza-

tion of objectivity. This way of thinking about objectivity holds that neutral,

scientific results can be achieved through the application of computational forms of

analysis � automated, algorithmic techniques performed by computers. In their

historical study of the prevailing ‘‘epistemic virtues’’ that have defined objectivity

over time, Daston and Galison (2007) use the term ‘‘mechanical objectivity’’ to referto the type of objectivity associated with photography and other visualizing

instruments developed in the nineteenth century. Proponents of ‘‘mechanical

objectivity’’ subscribed to the belief that mechanical devices could be used to

produce scientific images that were uncontaminated by interpretation, in contrast to

252 K. Gates

Page 12: Gates Cultural Labor of Surveillance

the artistically rendered, ‘‘true-to-nature’’ illustrations that populated scientific

atlases. Photography promised to remove the individual scientist’s judgment, and

the biasing hand of the illustrator, from scientific image making. But photography

and other mechanical visualization techniques never made good on this promise �the problem of image interpretation persisted � and what emerged in the twentieth

century, as an acceptable avenue to objectivity, was the epistemic virtue of ‘‘trained

judgment.’’ In this view, objectivity could best be achieved through the analytical

abilities and interpretive skills of well-trained human beings.

What we see emerging today is another kind of objectivity � a ‘‘computational

objectivity,’’ or an avenue to objective analytical results that aims to translate certain

aspects of trained judgment into computational systems. Along with the effort to

achieve ‘‘computational objectivity,’’ and to promote it as a new epistemic virtue,there is a renewal of the suspect promise that the biased and imperfect perceptual

capacities of human beings can be eliminated or designed out of computational

forms of image analysis. Computational models of vision, for example, promise to

automate aspects of what Charles Goodwin (1994) calls ‘‘professional vision,’’ or

‘‘socially organized ways of seeing and understanding events that are answerable to

the distinctive interests of a particular social group’’ (606). Certain professions like

medicine, science, law, and the police, writes Goodwin, ‘‘have the power to

legitimately see, constitute and articulate alternative kinds of events’’ (626), overand against other less powerful ways of seeing. ‘‘Professional vision is perspectival,

lodged within specific social entities, and unevenly allocated’’ (626), so techniques

that either facilitate or automate certain dimensions of professional vision

necessarily embody these social situated, unevenly distributed ways of seeing.

The belief in computational objectivity is a powerful counterweight to the

challenge that digital techniques pose for the principle of photographic truth so

important to the evidentiary value of images, whether in science, journalism, the law,

or other domains. But the belief that the biased and imperfect interpretive capacitiesof human beings can be designed out of computational forms of analysis depends on

a black-boxed view of technical systems. This view obscures both the culturally

specific models of human perception that get programed into automated systems, as

well as the central (if changing) role of human labor in the design and operation of

technical systems. In fact, the translation of professional trained judgment into

computational forms in the field of forensic image analysis is only a partial project.

The role of human perception and professional trained judgment not only persists,

but is itself being pushed in new directions, with new types of expertise taking shapein complex relationship with evolving professional norms, legal standards, and

technologies and cultural forms.

Surveillance video ‘‘asset management’’

‘‘Computational objectivity’’ can be said to encompass not only the application of

algorithmic techniques to specific images, but also the computational organization

of large collections of images in order to associate them with other data, identifypatterns and relationships, and make images available for later use. The need to

address image quality issues and to direct viewer attention to particular details

in specific video images are only the most obvious problems the investigators face

in attempting to exploit the evidentiary potential of surveillance video. Equally, if

Social Semiotics 253

Page 13: Gates Cultural Labor of Surveillance

not more important is what the media production industries call ‘‘media asset

management’’ � the problem of how to manage the quantity of video being

produced by CCTV systems, as well as the smaller collections of video deemed

relevant to particular investigations. In other words, the ability to optimize the

evidentiary potential of recorded surveillance video � to produce useable evidence

from a field of available imagery � is as much an archival or database management

problem as it is an image analysis problem. For media producers and organiza-

tions, effective management of their ‘‘media assets’’ is vitally important to the work

of media production. It is, likewise, important to the work of media evidence

production.

As a result of the widespread diffusion of CCTV, surveillance video has become

one of the most prolific sources of evidence in criminal investigations. One of the first

things the police do now when arriving at the scene of a crime is to look for cameras

(Lee 2005). According to the director of research for the International Association

for Police Chiefs:

It used to be you got to a crime scene and what you had was whatever was left there: acigarette stub or a tire skid . . .Now it’s possible to have between 5 and 10 video clips that[police] can gather from that area. (quoted in Lee 2005, A36)

Jonathan Hak, a crown prosecutor from Alberta, Canada, has noted that it is

‘‘routine now for police to seize video from places within a mile of where a crime

occurred’’ (quoted in Avid 2004). This new investigative practice of searching for

surveillance cameras after a crime has occurred, points to a challenge that works

against the meaningful use of recorded surveillance video as evidence, necessitating

the development of new technologies and procedures for the managing of video

assets as a fundamental part of evidence production: the highly decentralized and ad

hoc process of surveillance system diffusion, especially in the United States. Major

cities like New York, Chicago, and Washington, DC have instituted centralized

systems operated by the urban police force, but even these systems cover only

designated areas. The diffusion of CCTV systems for surveillance applications has

taken place to a significant extent in the private sector, by both in-house and

outsourced security systems, covering places like malls and retail centers, conve-

nience stores, banks, and casinos, college campuses, and the perimeter of office

buildings and corporate complexes. Although difficult to measure, private video

surveillance systems have far outpaced centralized police systems, introducing

challenges for police investigators attempting to gather and make use of the video.

Without new ways of managing this multiplication of dispersed visual informa-

tion � techniques for gathering, archiving, and retrieving information from this

vastly expanding field of imagery � the visual information generated by video

surveillance systems becomes virtually meaningless. Police, in partnership with the

security industry, are in fact developing new ways to manage the visual record of

reality from dispersed CCTV systems and other video sources. One example is a

product called the Omivore field acquisition tool, developed by Ocean Systems.

Omnivore is essentially a high-capacity thumb-drive device that allows users to

gather video from a variety of sources recorded in different proprietary formats � an

especially prevalent problem with private surveillance systems. According to the

company website, the device gives users:

254 K. Gates

Page 14: Gates Cultural Labor of Surveillance

the ability to capture evidence directly from the machine that recorded it and theninstantly view it without the need to load hard-to-find proprietary viewers. Omnivorealso generates a report that includes the DVR model, capture stats, location, time, andmore.15

In addition, rather than continue to gather video by physically searching the area,

some police departments have begun negotiating with private businesses to build

camera registries and gain access to their surveillance systems on an as-needed basis.

The City of Philadelphia, for example, has an online camera registry called

‘‘SafeCam,’’ where local businesses can provide information about the location of

their surveillance cameras.16 This way, when a crime occurs the police can go to the

registry to see what CCTV systems in the area may have captured relevant visual

information, without having to physically search the area for cameras. Other

partnerships of this sort are designed to give police direct, real-time, logical (or log-in)

access to private video systems on an as-needed basis, such as San Diego’s

‘‘Operation Secure San Diego’’ program launched in 2010. As described at the

SDPD website, officers can tap into live video feeds from computer terminals in their

police cars on the way to a participating place of business in response to a call for

assistance. Although descriptions of the program say nothing about police recording

the live video streams, it would not be difficult for the police to do so, and it would be

consistent with police tendency to be forward thinking about the need for evidence,

should an investigation of an incident become necessary.

After all video potentially relevant to an investigation has been gathered from the

field, it then needs to be processed and archived for effective retrieval and analysis.

Avid and Ocean Systems have responded to the needs of investigators for more

effective video archiving, media asset management, and image retrieval methods by

adapting nonlinear editing and work-sharing systems for investigative applications.

The ‘‘Avid Nearchive’’ system, according to a company brochure, is designed to

provide ‘‘a flexible, managed storage solution that provides seamless, rapid access to

evidence across an entire law enforcement network’’ (Avid 2004, 17) � a centralized,

searchable database for storing case reports, still images, MPEG videos and audio,

and other investigative information. The on-screen case notes already mentioned that

assign investigative meaning to video images also provide metadata for image

retrieval and cross-referencing. Video archiving and collaborative work-sharing

systems promise to help investigators do much more than analyze or enhance specific

images. Work-sharing systems are designed to allow users in different locations to

work with the same video material, enabling multiple investigators to work on single

cases at the same time and providing a means to link different cases over time and

even across departments or agencies.

In their large-scale investigation of the 2011 Vancouver Stanley Cup riots, for

example, forensic video analysts have made powerful use of work-sharing systems to

pool the labor of trained forensics professionals in the United States and Canada,

collectively processing tens of thousands of hours of video generated by CCTV

cameras and handheld devices the night of the riots. The video forensics’ component

of the riot investigation is establishing an important precedent that demonstrates the

power of distributive, collaborative work-sharing systems for mass identification in

crowd scenarios. (Any number of states might find such systems useful for managing

Social Semiotics 255

Page 15: Gates Cultural Labor of Surveillance

or repressing crowds, including not only sporting event riots but also organized mass

demonstrations.)

While dramatic ‘‘CSI moments’’ are rare in forensic video analysis, the use of

video forensics software systems to construct timelines of events, drawing on the full

range of evidentiary sources available in an investigation, provides a powerful

narrative tool for investigators. Programs like ‘‘Avid MetaSync’’ are designed toallow analysts to create timelines and attach ‘‘investigative assets’’ to the timelines

where appropriate, including photographs, video clips, statements, transcripts, and

other media. According to an Avid promotional video, ‘‘Avid MetaSync dramatically

changes the way video-related cases are presented in court,’’ by organizing video

evidence, integrating it with other elements of a case, and turning it ‘‘into a more

complete, accurate, and compelling witness in the courtroom.’’ Timelines can

be constructed to track a suspect’s movements in video gathered from multiple

sources, or to show how an event or series of events may have played out, piecing

together video with other evidence gathered in one or multiple investigations. The

timelines and reports produced in this way provide authoritative documentation for

courtroom presentation, lending a form of ‘‘documentary verification’’ to investiga-

tors’ narratives of events.17

These capabilities for using media asset management systems to optimize the

evidentiary potential of surveillance video raise the question of how the multimedia

database form changes the way narratives are constructed, whether in fictional ornonfictional genres of storytelling. In The Language of New Media, Lev Manovich

(2001) examines the relationship between the database and the narrative forms,

conceptualizing them ‘‘as two competing imaginations, two basic creative impulses,

two essential responses to the world’’ (233). ‘‘Modern media is the new battlefield for

the competition between database and narrative’’; he writes, ‘‘competing to make

meaning out of the world, the database and narrative produce endless hybrids’’ (234).

The question that then arises, according to Manovich, concerns how ‘‘our new

abilities to store vast amounts of data, to automatically classify, index, link, search,

and instantly retrieve it lead to new kinds of narratives’’ (237).

Here Manovich is interested primarily in the creative and aesthetic possibilities

opened up by the merging of database and narrative into new cultural forms. Like

Levin, his main focus is cinema, so he does not consider the possibilities opened up

for creating new kinds of documentary evidence or narratives of the real. What kinds

of narrative possibilities are introduced by the intersection of surveillance image

databases and the storytelling requirements of investigators and prosecutors? It is

not simply the ability to extract more information from images that is significant.Equally important is the capacity for organizing and reorganizing imagery, editing

shots together from multiple cameras, editing together different moments in time and

different locations � in general, the ability to apply nonlinear editing techniques to

the task of constructing coherent narratives from a chaotic field of surveillance

footage. The very real creative possibilities opened up by new database-narrative

assemblages means that the emerging field of video forensics must carefully define

the limits of its creative potential. Efforts to distinguish forensic video analysis from

the domain of creative media production can be found in the promotional language

used to define video forensics systems, as we have seen. They can also be found in the

new field’s commitment to the emerging epistemic virtue of ‘‘computational

objectivity’’.

256 K. Gates

Page 16: Gates Cultural Labor of Surveillance

Conclusion

One of the success stories that Avid features at its website to demonstrate the power

of its nonlinear editing, media asset management, and work-sharing systems is the

blockbuster film The Bourne Ultimatum (Marshall and Greengrass 2007). The film

was considered a major accomplishment in film editing, sweeping the editing

categories at the Oscars, that year. Like many action films out of Hollywood, the

Bourne production team worked with an ‘‘embryonic script,’’ the plot fully taking

shape only in postproduction. As Editor Chris Rouse admits in an Avid customer

testimonial, ‘‘this film would not have been completed if we hadn’t been working on

Unity,’’18 Avid’s (n.d.) media ‘‘asset management’’ system, ‘‘designed specifically for

storing, accessing, and sharing media in collaborative workgroup environments.’’19

In other words, the film exhibits and embodies some of the radical narrative

possibilities afforded by digital nonlinear editing techniques and the multimedia

database form.

The Bourne film is also replete with surveillant narration � surveillance-style

footage slips back and forth from computer screens that appear within the diegesis,

to shots that take up the space of the screen and become the film narration itself. If

the film is emblematic of a particular postproduction orientation to assembling big-

budget action films, it is, likewise, representative of the now prevalent use of

cinematic production as a site for negotiating the politics of surveillance, as Thomas

Levin (2002) has analyzed. Viewers are repeatedly treated to a surveillant perspective,

even as Bourne, the protagonist with whom we are meant to identify, uses his expert

spy training to subvert the state surveillance apparatus, at times harnessing it for his

own needs. Stephen Spielberg’s film, Minority Report (2002), also plays with

surveillant narration in ways that subtly express this ambiguity between the subjects

and objects of surveillance and between the real and imagined surveillant perspective.

These films express cultural anxieties about the perpetual ratcheting up of

technological surveillance capacity, even as they exploit that same capacity as

spectacle. Surveillance-style footage is now an integral part of the vast repertoire of

‘‘media assets’’ that filmmakers use to give their marvels of visual display a gritty

realist aesthetic.Just as new imaging, editing, and database technologies are enabling Hollywood

editors like Chris Rouse to make films that they could not have created otherwise,

video forensic systems designed using some of the same technologies are, likewise,

enabling an emerging professional class of law enforcement video analysts to

accomplish much more with expanding volumes of recorded surveillance video. The

varying levels of skill that forensic video analysts acquire in achieving an ‘‘aesthetics

of objectivity’’ in the production of video evidence cannot help but be informed by

the cultural prevalence of surveillant forms of narration, regardless of how

circumscribed evidence production techniques are by legal requirements. An analysis

of the social and cultural implications of surveillance video’s evidentiary uses should

not be limited to its role in particular investigations. More broadly, we need to make

sense of the ways that the field of video forensics and other types of media expertise

invest police institutions with renewed narrative authority in the new media

landscape, giving the police added ammunition in their constant battle of

interpretations over the prevailing ways of seeing crime, social disorder, and police

power itself.

Social Semiotics 257

Page 17: Gates Cultural Labor of Surveillance

Notes

1. I want to thank Fernando Dominguez for suggesting the phrase ‘‘aesthetics ofobjectivity.’’ Aaron Doyle (2006) also makes this point: ‘‘The truth-telling power of thetelevisual in general is supplemented by the crude underproduced quality of surveillancefootage in particular, which gives it a strengthened claim to authenticity’’ (211).

2. On the history of motion picture evidence in the US courts, see Schwartz (2009).3. In Maurizio Lazzarato’s (1996) often-cited definition, ‘‘immaterial labor’’ is defined as

‘‘the labor that produces the informational and cultural content of the commodity’’:

The concept of immaterial labor refers to two different aspects of labor. On theone hand, as regards the ‘‘informational content’’ of the commodity, it refersdirectly to the changes taking place in workers’ labor processes . . . where the skillsinvolved in direct labor are increasingly skills involving cybernetics and computercontrol . . . On the other hand, as regards the activity that produces the ‘‘culturalcontent’’ of the commodity, immaterial labor involves a series of activities that arenot normally recognized as ‘‘work’’ � in other words, the kinds of activitiesinvolved in defining and fixing cultural and artistic standards, fashions, tastes,consumer norms, and, more strategically, public opinion. (Lazzarato 1996)

4. Of course, no matter how much physical or manual labor is involved in policing thestreets, arresting criminal suspects, or firing weapons, police work has never involved thetype of physical or manual labor associated with a Fordist mode of production. From aMarxist perspective, the police are typically classed as ‘‘unproductive’’ labor: their labordoes not directly support capital accumulation but functions more indirectly in theprotection of property interests, and in the provision of security and social order thatenables a capitalist economy to function. (The professionalization of the modern policemore or less coincides historically with the rise of liberal democracies and their capitalisteconomies.) Of course, police officers and other law enforcement professionals arethemselves members of the working classes � people who sell their labor as a means ofsubsistence � and police workforces are no strangers to forms of alienation in the Marxistsense, or from labor struggles and battles for collective representation. But as historians ofthe police have demonstrated, the police historically have performed the capitalist-servinglabor of strike-busting and other forms of repressive regulation aimed directly at the urbanworking classes (Harring 1983; Tagg 1988). As workers and agents of the state, the policeoccupy a contradictory location in the structure of modern capitalist societies.

5. In his analysis of how the production of the show COPS affects the working practices ofthe police, Aaron Doyle explains that the police typically possess the ability to present theauthorized definition of the situations that unfold in front of the cameras, a form ofnarrative authority that not only pushes out onto audience impressions but also back ontopolice practice.

6. The ‘‘indexical’’ status of signs refers to their presumed ability to stand unequivocally foran existing material thing as a ‘‘matter of fact’’ or through a direct, physical connection.Canonical work on indexicality in semiotics is by the nineteenth-century philosopherCharles Sanders Peirce. See for example, Peirce (1998).

7. In his history of motion picture evidence in the US courts, Louis-Georges Schwartz(2009)argues that:

in court, the cinema of indexicality is not the same as film theory. In cinema suchindexicality is an implicit result of the medium itself and works to give thespectator an impression of reality. In court, film’s indexicality is a result of thecombination of a particular image and the testimony authenticating it, making theprocess of creating a particular image explicit. Evidentiary film’s indexicalityfunctions to purvey the facts of an event to the jury. (9)

It is true that the way cinema presents motion pictures (i.e., as completed texts ornarratives) is different from the way motion picture evidence is presented in court (i.e., notas complete narrative but as one piece of information supporting a larger narrative).However, I want to suggest that these two forms of indexicality are not as distinct at

258 K. Gates

Page 18: Gates Cultural Labor of Surveillance

Schwartz insists they are. Notwithstanding the distinct norms governing how indexicality isestablished in cinema versus fact-based domains like the courts and the press, the use of therhetoric of indexality in cinema, nonetheless, informs uses of indexality in other domains,and vice versa.

8. See Avid (Partnering for success).9. See Ocean Systems (n.d.a)

10. There is a good deal of literature on the ‘‘CSI effect.’’ See Cole and Rachel (2007).11. See Scheeres (January 20, 2002).12. See ABC News (April 4, 2012).13. These software filters enable forms of image enhancement and their evidentiary use

reminiscent of Charles Goodwin’s (1994) analysis of ‘‘professional vision.’’ In his analysisof the courtroom presentation of the Rodney King video, Goodwin shows how expert lawenforcement witnesses used techniques like cropping the images and pointing at specificobjects (namely, King’s body) in order to direct attention to desired targets of scrutiny. Inaddition to highlighting, law enforcement witnesses presented a coherent professionalcoding scheme for interpreting the forceful actions of the police officers as legitimaterestraint tactics. In this way, the defense effectively structured the perceptions of jurymembers according to the police frame of reference.

14. These uses of digital imaging support Kevin Robins’ (1996) argument that the ‘‘digitalrevolution’’ in photography is less a revolution than an effort to fulfill the rationalistprogram (157).

15. See Ocean Systems (n.d.b).16. See https://safecam.phillypolice.com/17. On ‘‘documentary verification, see Craig Robertson (2009).18. The Bourne Ultimatum testimonial video is no longer accessible at the Avid website.19. See Avid (n.d.).

Notes on contributor

Kelly Gates is a associate professor of Communication and Science Studies at the Universityof California, San Diego. She is author of Our Biometric Future: Facial RecognitionTechnology and the Culture of Surveillance (NYU Press, 2011).

References

ABC News. 2012. George Zimmerman: Enhanced video shows injury. April 4. http://abcnews.go.com/GMA/video/george-zimmerman-enhanced-video-shows-injury-trayvon-martin-16053206

Avid. n.d. Partnering for success. http://www.avid.com/us/partners.Avid. 2004. Forensics video analysis handbook: A blueprint for selecting a forensic video analysis

workstation. Company brochure. Burbank, CA: Avid.Avid. n.d. Unity MediaNetwork: Facility-class shared storage network. http://www.avid.com/

us/products/unity-medianetwork (accessed March 8, 2012).Cole, Simon, and Rachel Dioso-Villa. 2007. CSI and its effects: Media, juries, and the burden

of proof. New England Law Review 41, no. 3: 435�69. http://ssrn.com/abstract=1023258.Daston, Lorraine, and Peter Galison. 2007. Objectivity. Cambridge: MIT Press.Doyle, Aaron. 2006. An alternative current in surveillance and control: Broad-

casting surveillance footage of crimes. In The New Politics of Surveillance and Visibility,eds. K.D. Haggerty and R.V. Ericson, 199�224. Toronto, ON: University of Toronto Press.

Ericson, Richard V., and Kevin D. Haggerty. 1997. Policing the risk society. Toronto, ON:University of Toronto Press.

Goodwin, Charles. 1994. Professional vision. American Anthropologist 96, no. 3: 606�33.Groombridge, Nick. 2002. Crime control or crime culture TV? Surveillance and Society 1, no.

1: 30�46. http://library.queensu.ca/ojs/index.php/surveillance-and-society/article/view/3392/3355.

Social Semiotics 259

Page 19: Gates Cultural Labor of Surveillance

Harring, Sidney L. 1983. Policing a class society: The experience of American cities, 1865�1915.New Brunswick: Rutgers University Press.

Scheeres, Julia. 2002. Video forensics: Grainy to guilty. Wired, January 20. http://www.wired.com/politics/law/news/2002/01/50036.

Lazzarato, Maurizio. 1996. Immaterial labour. In Radical thought in Italy, trans. Paul Colilliand Ed Emory, eds. Paolo Virno and Michael Hardt, 132�146. Minneapolis, MN:University of Minnesota Press.

Lee, Jennifer. 2005. Caught on tape, then just caught. Private cameras transform police work.The New York Times, May 22, Metro section, National edition, p. 33.

Levin, Thomas. 2002. Rhetoric of the temporal index: Surveillance narration and the cinemaof ‘‘real time’’. In CTRL [SPACE]: Rhetorics of surveillance from Bentham to Big Brother,ed. T. Levin, U. Frohne, and P. Weibel, 578�93. Cambridge: MIT Press.

Lyall, Sarah. 2005. London bombers visited earlier, apparently on practice run. The New YorkTimes, September 21, National edition, p. A8.

Manovich, Lev. 2001. The language of new media. Cambridge: MIT Press.Marshall, F. (Producer), and P. Greengrass (Director). 2007. The Bourne Ultimatum. [Motion

picture.]. Universal City, CA: Universal Pictures.Mitchell, William J. 2001. The reconfigured eye: Visual truth in the post-photographic era.

Cambridge: MIT Press.Ocean Systems. n.d. Forensic clarification and analysis solutions. http://www.oceansystems.

com/dtective/index.phpOcean Systems. n.d. Omnivore: The next generation of . . . digital video field acquisition. http://

www.oceansystems.com/forensic/forensic_video_analysis/omnivore/Peirce, Charles S. 1998. The essential peirce. Vol. 2, Selected philosophical writings (1893�

1913), ed. Peirce Edition Project. Bloomington, IN: Indiana University Press.Robertson, Craig. 2009. A documentary regime of verification: The emergence of the US

passport and the archival problematization of identity. Cultural Studies 23, no. 3: 329�54.Robins, Kevin. 1996. Into the image: Culture and politics in the field of vision. New York, NY:

Routledge.Schwartz, Louis-Georges. 2009. Mechanical witness: A history of motion picture evidence in

U.S. Courts. New York, NY: Oxford University Press.Tagg, John. 1988. The burden of representation: Essays on photographies and histories. London:

MacMillan.Terranova, Tizianna. 2000. Free labor: Producing culture for the digital economy. Social Text

18, no. 2 63: 33�58.Wilson, Christopher. 2000. Cop knowledge: Police power and cultural narrative in twentieth-

century America. Chicago: University of Chicago Press.

260 K. Gates

Page 20: Gates Cultural Labor of Surveillance

Copyright of Social Semiotics is the property of Routledge and its content may not be copied or emailed to

multiple sites or posted to a listserv without the copyright holder's express written permission. However, users

may print, download, or email articles for individual use.