sharkfest 10 | stanford university | june 14–17, 2010 where netflow and packet capture complement...

54
SHARKFEST ‘10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th , 2010 Michael Patterson CEO | Plixer International, Inc. SHARKFEST ‘10 Stanford University June 14-17, 2010

Upload: irea-burford

Post on 28-Mar-2015

220 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Where NetFlow and Packet Capture Complement Each Other

June 17th, 2010

Michael PattersonCEO | Plixer International, Inc.

SHARKFEST ‘10Stanford UniversityJune 14-17, 2010

Page 2: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Course Outline

• What NetFlow is and how it works • Egress or Ingress• Comparison of the data exported by NetFlow vs.

Packet Analysis• What’s next in NetFlow, where the technology is going• Summary

Page 3: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

What is NetFlow?

How does it work?

Page 4: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Voice Traffic

Database Traffic

Instant Messenger

Web Browsing

Private & Business Email

Video Conferencing

Music streaming

Page 5: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

A

B

A - sending to B is one flow entry on every NetFlow capable router / switch in the path

B - acknowledging A is a 2nd flow

Page 6: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Scrutinizer Accepts• NetFlow all Versions

• sFlow version 2,4 and 5

• IPFIX

• NetStream

Page 7: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

2 Flows per Connection2 Flows per Connection

A B AB

Router1

2

4

A B3

Page 8: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Who Supports NetFlow?

• 3Com• Adtran• Cisco• Enterasys• Expand• Juniper

• Mikrotik

• nProbe• Riverbed• VMWare• Vyatta• Others…

Page 9: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

• Cisco

• Enterasys

• Foundry

• Hewlett Packard

• Nortel

• nProbe, nBox

• Many More

Page 10: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

MAC Addresses and VLAN IDs

• MAC addresses via Cisco ‘Flexible’ NetFlow (aka NetFlow v9)

Page 11: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

NetFlow or sFlow

• sFlow is an RFC not a standard• Sampling of every N packets technology

– Can’t be used for IP accounting like NetFlow

• Maintained by Inmon• Much less expensive for vendors to implement• Vendors: 3Com, AlaxalA, Alcatel-Lucent, Allied Telesis, Brocade, D-Link,

Extreme Networks, Enterasys, Force10 Networks, H3C, Hewlett-Packard, Hitachi, Juniper Networks, NEC and many others

Page 12: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

NetFlow NBAR

• NBAR stands for Network Based Application Recognition

• How many of you care if skype or pandora is on your network? Perhaps you don’t mind it but, want to know how much there is. Well, NBAR helps us with deeper packet inspection that isn’t available with traditional NetFlow.

Page 13: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Page 14: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Page 15: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Page 16: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Page 17: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Router CPU Impact

• Typically, the impact on the router’s CPU is negligible.

• However, NetFlow NBAR can clobber some routers.

Page 18: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Egress or Ingress

• Most of us are exporting NetFlow v5 which only supports ingress NetFlow. This means that traffic coming in on an interface is monitored and exported in NetFlow datagrams.

• Most NetFlow vendors look at where an ingress flow is headed by looking at the destination interface. Using this information, we can determine outbound utilization on any given interface as long as AND THIS IS IMPORTANT, you enable NetFlow v5 on all interfaces of the switch or router.

Page 19: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

When to use Egress• In WAN compression environments (e.g. Cisco WAAS, Riverbed, etc.), we need to see

traffic after it was compressed. Using Ingress flows causes an over stated outbound utilization on the WAN interface. Egress flows are calculated after compression.

• In multicast environments, ingress multicast flows have a destination interface of 0 because the router doesn’t know what interface they will go out until after it processes the datagrams. Exporting egress flows delivers the destination interface and as a result multiple flows are exported if the flow is headed for multiple interfaces.

• When exporting NetFlow on only one interface of the router or switch. Enabling both on a single interface means that all traffic in and out is exported in NetFlow datagrams.

Page 20: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Demonstration

Scrutinizer NetFlow & sFlow Analyzer

Page 21: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

NetFlow and Packet Analysis?

Page 22: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Example 1: FTP Comparison

Steps for the Lab• I started WireShark• I logged in and FTP’d a file• I logged out• I stopped WireShark• 6 Ingress Flows represent

2221 packets• 6 Egress Flows represent

1123 packets

Page 23: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

IngressLets count packets and compare with

Wireshark

Page 24: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Displaying Ingress

Total = 2221 packets

Page 25: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Displaying Ingress

Page 26: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

EgressLets count packets and compare with

Wireshark

Page 27: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Displaying Ingress

Total = 1123 packets

Page 28: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Displaying Egress

Page 29: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Capture DetailsLets compare NetFlow details to

Packet details

Page 30: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Page 31: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Page 32: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

What about Flags?

Page 33: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Example 2: www.llbean.com

Steps for the Lab• I started WireShark• I surfed to www.llbean.com• I went to another web site• I stopped WireShark• 2 Ingress Flows represents 11

packets going out from my PC• 1 Ingress Flow represents 13

packets coming back from llbean.com

Page 34: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

11 packets

From my PC (10.1.7.5) NAT’d by the firewall (66.186.184.62)

2 flows

Cisco Router

Page 35: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

11 packets

Enterasys Switch

From my PC (10.1.7.5)On the Enterasys switch before the router.

Page 36: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

13 packets

From www.llbean.com

Page 37: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

13 packets

From www.llbean.com

Page 38: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Example 3: VoIPSteps for the Lab• I started WireShark• I started iaxLite• I made a call• The other end picked up• I hung up• I closed iaxLite• I stopped WireShark• 1 Ingress Flow represents 1364 UDP

packets• 1 Egress Flow represents 1364 UDP

packets

Page 39: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

1364 packets

My Computer to the PBX

Page 40: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

1364 packets

My Computer to the PBX

Page 41: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

1364 packets

PBX to My Computer

Page 42: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

1364 packets

PBX to My Computer

Page 43: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Distributed Collectors

Page 44: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Page 45: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Detecting Malware

Page 46: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Network Behavior Analysis• Network Behavior Analysis

– Constantly monitor NetFlow and sFlow from selected routers and switches

– Looks for traffic patterns defined in behavioral algorithms

– Additional filters can be created to look for unique circumstances

• Demonstration

Page 47: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Future of NetFlow

Current Innovations

Page 48: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Latency via NetFlow

Page 49: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

RTT and Server Latency

These fields got cut.

Page 50: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

URL Information

Page 51: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

WAN Optimization Sizing

Page 52: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Procflow from Gerald Combs

Page 53: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

What is next from NetFlow?

• Packet captures• Sampling Flows • IPv6 is here and we are reporting on it.• Syslogs: Cisco ASA. We already provide

reports on this.

Page 54: SHARKFEST 10 | Stanford University | June 14–17, 2010 Where NetFlow and Packet Capture Complement Each Other June 17 th, 2010 Michael Patterson CEO | Plixer

SHARKFEST ‘10 | Stanford University | June 14–17, 2010

Summary

• Ingress Vs. Egress NetFlow• Advanced Filtering to narrow in on problems• How and When to leverage reports• The differences between NetFlow and Packet

Capture• Where the technology is going