islands of node in a sea of big data
TRANSCRIPT
![Page 1: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/1.jpg)
Islands of node in a sea of Big Data
Glenn Block
Splunk Dev Platform
CC Image Carlota and Isabel Islands by Storm Crypt Flickr
![Page 2: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/2.jpg)
About me
![Page 3: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/3.jpg)
3
Glenn Block
![Page 4: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/4.jpg)
4
![Page 5: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/5.jpg)
5
Glenn Block
![Page 6: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/6.jpg)
What is Splunk?Any Machine Data
HA Indexes and Storage
Search and Investigation
Proactive Monitoring
Operational Visibility
Real-time Business Insights
CommodityServers
Online Services Web
Services
ServersSecurity GPS
Location
StorageDesktops
Networks
Packaged Applications
CustomApplicationsMessaging
TelecomsOnline
Shopping Cart
Web Clickstreams
Databases
Energy Meters
Call Detail Records
Smartphones and Devices
RFID
![Page 7: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/7.jpg)
7
![Page 8: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/8.jpg)
node in the box
![Page 9: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/9.jpg)
Let's generate some PDFs
9
![Page 10: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/10.jpg)
How we do it
10
node
JSONJSON
pdfchartjsdom
![Page 11: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/11.jpg)
Why node?
11
• We needed an easy way to convert a web page into PDF
Node has modules for rendering web pages on the server (JSDOM)
Node has modules for PDF generation (PDFKIT)
![Page 12: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/12.jpg)
12
![Page 13: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/13.jpg)
13
![Page 14: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/14.jpg)
14
![Page 15: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/15.jpg)
15
![Page 16: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/16.jpg)
Why node?
16
We needed a mobile-friendly façade for our non-mobile friendly API
The server is heavily IO bound / async, which node is perfect for.
It is easy and lightweight to spin up API servers and proxies in node. Great support for Auth as well.
![Page 17: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/17.jpg)
17
node for integration and extensiblity
![Page 18: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/18.jpg)
18
![Page 19: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/19.jpg)
Log directly to Splunk via TCP,
UDP, HTTP
Integrate search results with other applications using
custom visualizations
Create and run searches from
other applications
Splunk SDK
19
VisualizeSearch Manage
Add/Delete Users
Manage Inputs
Index
![Page 20: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/20.jpg)
node inputs
20
Public APIs DevicesOS levelInternal Systems
Generating test data
Input
![Page 21: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/21.jpg)
Ingesting data with Socket.IO
21
![Page 22: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/22.jpg)
Why node?
22
Inputs by their nature are heavily IO bound and async
Inputs are streaming results back to Splunk and node has great support in the box for streams.
It has a great ecosystem of modules
It’s JavaScript!
![Page 23: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/23.jpg)
23
browserify
requirejsjsdom
pdfkit
htmlparser
koa
mocha
grunt
express
node-http-proxy
jshint
![Page 24: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/24.jpg)
Where to go for More Info
• Tutorials, Code Samples, Getting Started, Downloads– http://dev.splunk.com/javascript– https://github.com/glennblock/splunk-socket.io
• Support– https://www.splunk.com/page/submit_issue
• GitHub– https://github.com/splunk/splunk-sdk-javascript
• Twitter– https://twitter.com/splunkdev or follow me:
https://twitter.com/gblock
• Blog– http://blogs.splunk.com/dev/
24
![Page 25: Islands of Node in a sea of big data](https://reader033.vdocument.in/reader033/viewer/2022051617/55a52c431a28ab82678b47dd/html5/thumbnails/25.jpg)
Thank You!