Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

July 2013

Klaus Doppler, NokiaSlide 1

Evaluation Criteria and Simulation Scenarios

Date: July 16, 2013Authors:

Name Company Address Phone email Klaus Doppler, Sayantan Choudhury, Esa Tuomaala, Chittabrata Ghosh, Mika Kasslin, Jarkko Kneckt, Janne Marin, Prabodh Varshney, Gabor Bajko

Nokia 2075 Allston Way, Berkeley, CA

+1 510 4232 458 Klaus.doppler@nokia.com Jarkko.kneckt@nokia.com

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Abstract

• The presentation proposes evaluation criteria for HEW

• The presentation introduces the requirements of the simulation scenarios

• One new simulation scenario for high density of APs and high density of terminals per AP is proposed

Slide 2

July 2013

Klaus Doppler, Nokia

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Recap, mission of HEW

• Creation of HEW• Do you support starting a new study group called “high efficiency WLAN”

to enhance 802.11 PHY and MAC in 2.4 and 5GHz with a focus on: • Improving spectrum efficiency and area throughput• Improving real world performance in indoor and outdoor deployments

– in the presence of interfering sources, dense heterogeneous networks

– in moderate to heavy user loaded APs

• Evaluation criteria and simulation scenarios– Reflect the focus of HEW– Provide significant step forward from 802.11ac that is noticeable by

the end user

July 2013

Klaus Doppler, NokiaSlide 3

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Proposed evaluation criteria

• The proposal is to have two criteria for proposal evaluation– Area throughput

– 5 percentile user throughput

• Area throughput [bit/s/Hz/m2]– HEW focus is system efficiency that is measured by area throughput

– Aggregate throughput for a given number of APs and STAs in a given area and given frequency band. The simulation scenario defines the available spectrum and APs optimize the use of the spectrum

– Similar to average BSS throughput or average STA throughput in homogenous scenario

July 2013

Klaus Doppler, NokiaSlide 4

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Proposed evaluation criteria

• 5 percentile of user throughput cumulative distribution function (CDF)– CDF of user throughput indicates nicely the distribution of the

throughputs

– Users expect a consistent user experience from wireless networks, i.e. when connected they expect at least minimum performance

– 5 percentile of the user throughput CDF is a good measure of the minimum performance; at least 95% of users gets better throughput

• The area throughput and 5 percentile user throughput are evaluated at the same time

• The area throughput and 5 percentile user throughput are calculated per access category

July 2013

Klaus Doppler, NokiaSlide 5

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Requirements for simulation scenarios

• The simulation scenarios are examples to proof that HEW performance criteria are fulfilled• They enable benchmarking of the proposed enhancements

• Should reflect the intended use of HEW

• Should be clearly defined and simple enough that they can be implemented by a large set of companies– Large set of companies need to contribute to HEW to make it

successful

– It is important that new concepts and features are evaluated in the intended usage scenarios

July 2013

Klaus Doppler, NokiaSlide 6

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Requirements for simulation scenarios

• There should be relevant number of simulation scenarios to demonstrate HEW performance in different scenarios

• Baseline scenarios need to be agreed to be able to compare results of different companies– Calibration and understanding of simulation results is important

– 802.11n or 802.11ac scenarios may be used to verify the correctness of the simulator

July 2013

Klaus Doppler, NokiaSlide 7

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Simulations scenarios of 802.11n

• 802.11n defines 5 simulation scenarios (11-03/814r31)– The simulation scenarios focus on the performance of single BSS– The simulation scenarios contain different traffic types; VoIP, low

throughput streaming and best effort data– The transmitted traffic types, and locations of the AP and terminals

are precisely defined

• A lot of simulation results were published. Many simulations results show:– QoS is achieved. The high Access category traffic is transmitted and

remaining capacity is left to best effort data– By tuning the EDCA parameters, the results can be set to favor high

priority or best effort data

July 2013

Klaus Doppler, NokiaSlide 8

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Simulation scenarios of 802.11ac

• 802.11ac defines 5 simulation scenarios (11-09/451r16)– The simulation scenarios focus on the performance of single BSS

and simple overlapping BSSs

– The simulation scenarios contain high bit rate real time video streaming and best effort data

– The transmitted traffic types, and locations of the APs and terminals and are precisely defined

– The primary channels and bandwidths of the APs are precisely defined

• No simulation results were published– Hard to estimate 802.11ac performance

July 2013

Klaus Doppler, NokiaSlide 9

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Shortcomings of 802.11ac scenarios for HEW

• Scenario 4 (OBSS scenario) of 802.11ac

– Number of OBSSs and STAs is low

– Checking user throughput for each STA may be cumbersome and hard to compare

– Defining a large scenario with this level of details is complicated

July 2013

Klaus Doppler, NokiaSlide 10

0-20-40-60 604020 x-20

20

0

y

BSS A BSS BBSS C

APSTA

STA 18STA 19

STA 20

STA 15STA 16

STA 17

room walloutside wall

STA 1

STA 2STA 7

STA 5

STA 4STA 10

STA 11

STA 12

STA 13

STA 9

STA 6

STA 14

AP STA 3

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

New scenario, network topology and device locations

• Multi-floor building– Important scenario in many countries. Fiber to the home

offers >>1Gbps backhaul capacity

– 10 floors, 3 m height in each floor– 2x10 rooms in each floor– Room size:10m x 10m x 3m

• AP locations (assuming 150 APs):– Place 150 APs in the randomly selected rooms at xy-

location (uniform distribution) at 1.5m above floor level

– At maximum one AP per room

• STA locations, 5 STA/AP (=750 STAs):

– In each room that has an AP, place five STAs in random xy-locations (uniform distribution) at 1.5m above the floor level

– Each of the five STAs in a room is associate to the AP in the room

July 2013

Klaus Doppler, NokiaSlide 11

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

New scenario, traffic model and channel assignment

• Constant Bit Rate traffic of DL or UL traffic– DL or UL traffic is randomly assigned to a STA

– 80% of STA with 100Mbps DL traffic

– 20% of STA with 100Mbps UL traffic

– Packet size 1500B

• 5GHz: at least 3 non-overlapping 80MHz channels– Option 1: Random assignment of AP to channel

– Option 2: Simple distributed assignment• Step 1: Each AP picks random channel

• Step 2: Randomly selected AP picks channel with maximum pathloss to next AP

• Step 3: Repeat Step 2 10xNumAP to find the best operating channel for each AP

• Run simulations with resulting channel assignment

• 2.4GHz: 3 non-overlapping 20MHz channels– Same assignment procedure as in 5GHz

– 802.11n channelization may be used at 2.4 GHz

July 2013

Klaus Doppler, NokiaSlide 12

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

New scenario, simulation run parameters

• The scenario should be simulated at least 10 times– In each simulation the locations and APs and STAs are randomly

selected

• Each simulation run should simulate at least 10s of time• The simulation run may contain only APs operating at

the same 80 MHz channel and associated STAs – Option 1 All APs have the same primary channel

• APs and STAs operating outside the 80MHz channel need not be simulated

• 50 APs and 250 STAs are present in one simulation run

– Option 2: Free selection of the primary channel

July 2013

Klaus Doppler, NokiaSlide 13

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Baseline scenario example parameters

• Transmit power– Max AP TxP 23dBm – Max STA TxP 19dBm

• Antenna configuration– MIMO / beam forming– AP/STA: 2/2– AP/STA: 4/2

• Antenna gain– Option 1: 0dBi Omni antenna pattern– Option 2: 3dBi 3D dipole antenna

pattern

• Power control

• Link Adaptation– Enabled: SNR based?

July 2013

Klaus Doppler, NokiaSlide 14

• Carrier Sensing– PD threshold -82dBm– ED threshold -62dBm

• EDCA parameters– Default values– AC_BE (Best effort) traffic

• RTS/CTS– Option 1: Off– Option 2: On

• Aggregation– MPDU: max 20

– MSDU: max 2

• Block Acknowledgement– Enabled

• The values may be optimized. The values of the these paramters should be listed with the simulation results.

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Additional simulation results

• Additional information recommended to provide, e.g.:– results to indicate how the user throughputs and MCS were

distributed – user throughput CDF curves in addition to area throughput and 5

percentile of CDF numbers– MCS fluctuation histogram for a given STA or AP throughout the

simulation

• Example illustration of thethroughputs:– Black dots are APs – Colors indicate average

throughputs of the terminals

July 2013

Klaus Doppler, NokiaSlide 15

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Summary

• 5 percentile of user throughput cumulative distribution function and area throughput are proposed as metrics to quantify the gains for HEW enhancements

• The requirements of the simulation scenarios are defined

• New simulation scenario is proposed for dense apartment building use case as outlined in slides 11-14

July 2013

Klaus Doppler, NokiaSlide 16

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

APPENDIX

July 2013

Klaus Doppler, NokiaSlide 17

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

Mobile video drives mobile data traffic

• Video is dominant application

• Netflix in HD currently uses 7Mbps*

• Video is moving towards 4k (4x1080p) and 8k (16x1080p)

• Increasing shareof TVs with Wi-Fi support**

Slide 18 Klaus Doppler, Nokia

July 2013

* https://support.netflix.com/en/node/8731 ** 4 out of 10 top selling TVs on Amazon.com April 22, 2013

Doc. No. IEEE 11-13-0847-00-0hew-r1

Submission

July 2013

Klaus Doppler, NokiaSlide 19

Dense apartment building

Pre-ConditionsEach apartment has Wi-Fi network deployed to access internet and cloud services. In each apartment up to 3 users stream concurrently video content from the network and up to 50% of the networks are active.

At the same time each of the active Wi-Fi networks is used by 2 users for web browsing

Environment Building with 100 apartments. One AP in each apartment of 10mx10m randomly positioned. 5 STA per AP randomly positioned in the apartment.

ApplicationsCloud based applications supporting video streaming with 8k resolution.

Video requirements are: ~112Mbps per STA (16x1080P), delay is < 200ms, 1.0E-3 PER.

The application is able to buffer up to 2s of the content to avoid interruptions of the service, allowing relaxed delay requirements

Web browsing requirements for Social Networking are: ~20Mbps, PER 1e-3, delay<50ms, 1.0E-3 PER

150 active video users and 100 active web browsing users in the building with an aggregate data rate requirement of 18.8Gbps in the building.

The service requirements should be met for 98% of the users in the building.

Traffic ConditionsStrong interference from overlapping networks (neighboring apartments, and outdoor Wi-Fi network). Multiple video display are operational simultaneously.

Use CaseUser starts cloud video service on a fixed or mobile device with 8k display.

The cloud service streams the video in 8k format.