Download - Bringing the Real World Into the Game World
![Page 1: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/1.jpg)
Bringing the Real World into the Game
World with Intel® RealSense™ Technology Geoffrey Douglas, Games Engineer
6
![Page 2: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/2.jpg)
#buzzworkshop #gamedev @intelsoftware
About Me
![Page 3: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/3.jpg)
#buzzworkshop #gamedev @intelsoftware
Executive Summary
• RealSense Technology can be used to develop games that bridge the gap between the real world and the virtual world to create new and powerfully immersive experiences.
• Developing with new technology like RealSense is a huge challenge. But sometimes the solutions to the hardest problems turn out to be the most amazing innovations.
• Ultimately, our goal is for RealSense to be the next big thing in gaming, and we need talented developers to help us make that happen.
![Page 4: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/4.jpg)
4
RealSense Overview
• RealSense Cameras
• RealSense SDK Overview
• Developing with the SDK
Gaming Usages
• ChatHeads
• 3D Selfie
• Augmented Reality
Agenda
#buzzworkshop #gamedev @intelsoftware
![Page 5: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/5.jpg)
5
RealSense Overview
#buzzworkshop #gamedev @intelsoftware
![Page 6: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/6.jpg)
6
• Front-Facing (User-Facing)
• Short-Range
• Designed for laptops and 2-in-1s, on the front, above the screen
• Rear-Facing (World-Facing)
• Long-Range
• Designed for 2-in-1s and tablets, on the back, at the top of the device
RealSense Cameras
![Page 7: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/7.jpg)
7
RealSense SDK
SDK
Core I/O
Modules Algorithm
Modules
C++ Interface
Algorithm
Modules
C# Interface Unity Interface JavaScript Java Interface
#buzzworkshop #gamedev @intelsoftware
Unreal Engine 4
Interface
![Page 8: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/8.jpg)
8
RealSense SDK Middleware
Hand Tracking Hand Tracking
Speech Recognition
Blob Tracking
Head/Face Tracking
Gesture Recognition Scene Perception
Background Segmentation
3D Scanning
#buzzworkshop #gamedev @intelsoftware
![Page 9: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/9.jpg)
#buzzworkshop #gamedev @intelsoftware 9
Using the SDK
int main() {
// Create SenseManager Object
PXCSenseManager *sm = PXCSenseManager::CreateInstance();
// Enable Color and Depth video streams
sm->EnableStream(STREAM_TYPE_COLOR, 1920, 1080, 30.0f);
sm->EnableStream(STREAM_TYPE_DEPTH, 640, 480, 30.0f);
...
![Page 10: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/10.jpg)
#buzzworkshop #gamedev @intelsoftware 10
// Enable and Configure Middleware Module(s)
sm->Enable3DScan();
PXC3DScan* scan = sm->Query3DScan();
scan->SetConfiguration(/*...*/);
// Initialize the SenseManager pipeline
sm->Init();
...
![Page 11: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/11.jpg)
#buzzworkshop #gamedev @intelsoftware 11
// Begin camera processing loop and acquire new frame
while(sm->AcquireFrame() == PXC_STATUS_NO_ERROR) {
// Process camera frame
PXCImage* image = scan->AcquirePreview();
// Release the working frame
sm->ReleaseFrame();
}
...
![Page 12: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/12.jpg)
#buzzworkshop #gamedev @intelsoftware 12
// Close the SenseManager pipeline
sm->Close()
// Release the SenseManager resources
sm->Release();
return 0;
}
![Page 13: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/13.jpg)
13
Gaming Usages
#buzzworkshop #gamedev @intelsoftware
![Page 14: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/14.jpg)
#buzzworkshop #gamedev @intelsoftware 14
ChatHeads
![Page 15: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/15.jpg)
#buzzworkshop #gamedev @intelsoftware
3D Selfie
15
![Page 16: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/16.jpg)
#buzzworkshop #gamedev @intelsoftware 16
Video Demo
![Page 17: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/17.jpg)
#buzzworkshop #gamedev @intelsoftware 17
Augmented Reality
![Page 18: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/18.jpg)
#buzzworkshop #gamedev @intelsoftware 18
Scan-Then-Play
![Page 19: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/19.jpg)
#buzzworkshop #gamedev @intelsoftware 19
Continuous Scanning
![Page 20: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/20.jpg)
#buzzworkshop #gamedev @intelsoftware 20
Bonus: Head Tracking!
![Page 21: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/21.jpg)
#buzzworkshop #gamedev @intelsoftware
Conclusion
• RealSense Technology can be used to develop new games that bridge the gap between the real world and the virtual world to create powerfully immersive experiences.
• There are a lot of new use cases that we’re exploring in 2016 and beyond that we hope will make RealSense a must-have device for gamers.
![Page 22: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/22.jpg)
#buzzworkshop #gamedev @intelsoftware 22
Call to Action
• Contact us if you want to work together on a new RealSense game, or if you’d more information.
• Watch out for some RealSense games to hit the market this year and see what you think.
https://appshowcase.intel.com/en-us/realsense
• Get excited about the future of gaming. It’s going to be great.
![Page 23: Bringing the Real World Into the Game World](https://reader034.vdocument.in/reader034/viewer/2022051520/589c7e331a28abc2258b5acb/html5/thumbnails/23.jpg)
#buzzworkshop #gamedev @intelsoftware 23
Thank You
https://software.intel.com/en-us/articles/ intel-realsense-sdk-plug-in-for-unreal-engine-4
https://software.intel.com/en-us/articles/ applying-intel-realsense-sdk-face-scans-to-a-3d-mesh
https://software.intel.com/en-us/articles/ intel-realsense-sdk-background-segmentation-feature
https://software.intel.com/en-us/articles/ native-intel-realsense-sdk-image-copying-in-unity
Contact: Geoffrey Douglas [email protected]