validation test scope
Post on 21-Dec-2015
14 Views
Preview:
TRANSCRIPT
1. Latency Test
Site-Lat01 First time network Attach delay( with Authentication & Encryption turned on and No RAB & UE context )
Site-Lat02
Site-Lat03
Site-Lat04
Site-Lat05 TAU update & paging delay
2. Throughput and Capacity Test with multiple users
Site-THR_01
Site-THR_02 No of users scheduled per TTI in a single cell and complete eNB3. RRM
Site-RRM01 Admisson and congestion control feature
Site-RRM02 Load balance in intra/ inter cells /Frequencies
4. QoS & Scheduler TestSite-QoS01 QoS Profile( all QCI support as per 3GPP specifications
Site-QoS02 GBR and Non-GBR priority ( QCI priority)
Site-QoS03 Service differentiations for non-GBR / GBR bearers, EPS bearer
Site-QoS04 Uplink and Downlink Rate Capping
Site-QoS05
Note:- a. Document is based on current visibility of features & roadmap, however the scope defined below will be refreshed after mutual discussion, as in when the new releases/features are available and not specified in the list below b. Pass/Fail criterion of each test to be mutually discussed/agreed and to be included in the VT test document submitted by Partnerc. Functional Testing will be verified in this section however gains quantifications will be done in cluster or lab testing based on agreed test procedure
Paging latency, stationary, target user in cell center/middle/edge, 50% load
Idle to active ( control plane latency) , stationary, target user in cell near/middle/edge at no load & 50% adjacent cell downlink loading
User plane latency- RTT delays to be captured for different ping packet size at no loading and 50% serving cell loading
Average cell throughput with maximum RRC connected/scheduled users distributed in different points uniformly in a cell
QoS parameter provisioning (Support for user traffic classification based on L2, L3, L4 Rules i.e. Physical port, MAC address, IEEE 802.1q tag, IEEE 802.1p tag, TOS/DSCP bit, Ethernet /IP protocol type, Source and destination IP address, Source and destination TCP/UDP/RTP port nos
Site-QoS06 Different IP for MCUS-plane
Site-QoS07 Dynamic Admission control
Site-QoS08 VLAN based traffic separation
Site-QoS09
Site-QoS10
Max C/I
EPF ( enhanced PF which can also factor user Qos profile )
PF
RR
Prioperatory scheduler ( if any)
Site-QoS11 User plane & Control Plane Encryption
5. SONField-SON01 Verify the X2 signaling message exchanges Field-SON02 Auto Discovery & Configuration (Plug & Play integration)Field-SON03 Self Healing Field-SON04 Cell outage detection & compensationField-SON05 Sleeping Cell detection and repair
Field-SON06 ANR ( Automatic Neighbour Relation) - Intra & Inter RAT
Field-SON07 RACH optimization
Field-SON08 Control channel optimisation
Field-SON10 Mobility Robust optimisation (MRO) ( intra & inter frequecny and cells/RATscenario)
Field-SON11 MDT
Field-SON12 Optimized Neighbor relationship ( Auto neigbhor defination by OSS )
Field-SON13 Auto PCI planning
Field-SON14 Auto PCI collision detection
Field-SON15 Auto Alarm Coorelation and Trace
Field-SON16` Mobility load balancing (MLB)
6. Services Test ( Functionality will be verified in this section however corresponding gains will be verified as part of cluster or lab testing )
Field-ST01 Video Streaming, HD Videro Surveillance & Video Call
Field-ST02
Field-ST03 CSFB
Field-ST04 VoLTE
Field-ST05
Verification of Base Station mechanism to prohibit transmission of packets between subscribers registered in same base station.
Data download and upload -- throughput, delay, and jitter to 10 sites around the world, youtube download, etc.
NAAC (Network Assisted Cell Change) - reselection, redirection, active PS HO with data session continuity for different RAT type
Field-ST06 SRVCC & enhancement
Field-ST07
Field-ST08 Location Identification for LBS services
Field-ST09 Support for Multicast & Broadcast Services (eMBMS)
Field-ST10 VLAN configuration/tagging (IEEE 802.1q) capability at CPE level and support by eNB
Field-ST11 No. of VLANs supported per interface (by BSs, CPEs)
Field-ST12 Support for IPv6 & Dual stack IP V4 /IP V6
Field-ST13 Q in Q functionality support by eNB
Field-ST14 TTI Bundling
Field-ST15 SPS scheduling
Field-ST16 Relay ( L1, L2 & L3 type)
Field-ST17 WiFi Public hotspot Integrated services with LTE
Field-ST18 Carrier aggregation ( in same & multi band )
Field-ST19 RRU Daisy chaining
Field-ST20 Cell combination ( Super cell )
Field-ST21 Remote GPS
Field-ST22 TM9 (CL-SU / MU MIMO & multilayer Beamforming)
Field-ST23 4x4 MIMO in Downlink
Field-ST24 Hetnet ( interworking of small cells and macro cells )
Field-ST25 Active RAN sharing
Field-ST26 eScheduler /coordinator
Field-ST27 Hotel BBU
Field-ST28
Field-ST29
Support for VOIP- Class 5 features (Call waiting, Hold, 3 party conferencing etc.) , Call quality with different codecs
TM 7 & TM 8 ( Single layer and Dual Layer Beamforming). Also includes different types of BF like elevation, weight loading adaptive etc
TM -1 to TM-6 testing which includes SISO, SU & MU MIMO , Diversity , Open & closed loop MIMO for 2 port and 4 port scenario
Field-ST30 CoMP ( uplink- intra & inter cell )
Field-ST31 CoMP ( downlink- intra & inter cell )
Field-ST32 Active Antenna Array
Field-ST33 SDR ( dual band dual carrier )
Field-ST34 EWS system
Field-ST35 S1 - Flex
Field-ST36 eNB Co Transmission backhauling capabilities ( 4G , 3G & IP Abis)
Field-ST37
Field-ST38 TOP support on eNB ( 1588v2) & GPS clock Freq. & Phase clock backup
Field-ST39 64 Qam Support on uplink
Field-ST40 Jumbo Frame support
Field-ST41 Robust Header Compression | IP & SCTP transport enhancement
Field-ST42 IPv4/IPv6 dual stack & pur IPv6 support
7. eNB Power Consumption ( to be verified for all confiuration type installed in the network)
Site-Pwr-001
RRU power consumption in no load condition
BBU power consumption in no load condition
8.Service Recovery timing/behaviour in various outage scenarios
Site-NE01 MME
Site-NE02 PDN Gateway
Site-NE03 Serving Gateway
Site-NE04 Transmission
Site-NE05 eScheduler/coordinator
Site-NE06 eNB Hard & Soft reboot
9. Interference Supression Techniques ( Functionality will be verified in this section however corresponding gains will be verified as part of cluster or lab testing )
Field-INT01
Different Configuration support like TDD splits , Special subframe, Cyclic prefix (short , Long) , Channel bandwidth
RRU Power in with 50% & 100% load at room temperature ( RRU transmitting at full power in 100% loading)
BBU Power with 50% load & 100% load( BBU loading is determined by CPU load - max users & throughput load )
Verify Interference mitigation techniques for both uplink & downlink for User traffic a. Static ICIC b. Dynamic ICIC ( pure X2 feedback based c. enahnced ICIC ( X2 & UE CQI / QOS feedback) d. ICIC coordinated using centralized server e. FSS ( Frequence slective scheduling - wide band & sub band CQI feeedback based )
Field-INT02 Interference Control for Control channels CCO, CCLR, CCIA , Control channel power control
Field-INT03 IRC, MRC
Field-INT04 Closed Loop and Open loop power control
10. eNB Hardware Test
Field-FP01
11. Energy Saving ( This heading covers all Opex saving related features that are developed by Partners and should not restrict to specifc mentioned below)
Field-PS01 Automatic PA Shut down ( time based & load based)- Load based power saving
Field-PS02 DRX Long & Short ( smart DRX)
Field-PS03 RS Power boosting & Cell power reduction for control & traffic channels
Field-PS04 DTX
12. Handover ( all handover includes intra & inter cells /RAT type/frequency )
Field-HO01 S1 & X2 Handover & delaysField-HO02 IRAT Handover & delays Field-HO03 Load based handoverField-HO04 Service based HO
Verify the eNB RX sensitivity, Transmit Power, Occupied Bandwidth, Time alignament, ACLR, Filter Rejection, ACS & SEM, Control & Data Channels Powers & RB allocation. OBSAI/CPRI Std measurements
Actual value
1. Latency Test
First time network Attach delay( with Authentication & Encryption turned on and No RAB & UE context )
At cell edges ( RSRP < -110 dbm) At cell center ( RSRP range <-95 to -110) At near cell ( RSRP > -95) At cell edges ( RSRP < -110 dbm) At cell center ( RSRP range <-95 to -110) At near cell ( RSRP > -95)
TAU update & paging delay
2. Throughput and Capacity Test with multiple users
No of users scheduled per TTI in a single cell and complete eNB3. RRM
Admisson and congestion control feature
Load balance in intra/ inter cells /Frequencies
4. QoS & Scheduler TestQoS Profile( all QCI support as per 3GPP specifications
GBR and Non-GBR priority ( QCI priority)
Service differentiations for non-GBR / GBR bearers, EPS bearer
Uplink and Downlink Rate Capping
a. Document is based on current visibility of features & roadmap, however the scope defined below will be refreshed after mutual discussion, as in when the new releases/features are available and not specified in the list below b. Pass/Fail criterion of each test to be mutually discussed/agreed and to be included in the VT test document submitted by Partnerc. Functional Testing will be verified in this section however gains quantifications will be done in cluster or lab testing based on agreed test procedure
Planned value(Shall be provided by Partner in advance as per
planning assumptions & global experience)
User plane latency- RTT delays to be captured for different ping packet size at no loading and 50% serving
Average cell throughput with maximum RRC connected/scheduled users distributed in different points
QoS parameter provisioning (Support for user traffic classification based on L2, L3, L4 Rules i.e. Physical port, MAC address, IEEE 802.1q tag, IEEE 802.1p tag, TOS/DSCP bit, Ethernet /IP protocol type, Source and destination IP address, Source and destination TCP/UDP/RTP port nos
Different IP for MCUS-plane
Dynamic Admission control
VLAN based traffic separation
Max C/I
EPF ( enhanced PF which can also factor user Qos profile )
PF
RR
Prioperatory scheduler ( if any)
User plane & Control Plane Encryption
5. SONVerify the X2 signaling message exchanges Auto Discovery & Configuration (Plug & Play integration)Self Healing Cell outage detection & compensationSleeping Cell detection and repair
ANR ( Automatic Neighbour Relation) - Intra & Inter RAT
RACH optimization
Control channel optimisation
Mobility Robust optimisation (MRO) ( intra & inter frequecny and cells/RATscenario)
Optimized Neighbor relationship ( Auto neigbhor defination by OSS )
Mobility load balancing (MLB)
6. Services Test ( Functionality will be verified in this section however corresponding gains will be verified as part of cluster or lab testing )
Video Streaming, HD Videro Surveillance & Video Call
CSFB
VoLTE
Verification of Base Station mechanism to prohibit transmission of packets between subscribers registered
Data download and upload -- throughput, delay, and jitter to 10 sites around the world, youtube download,
NAAC (Network Assisted Cell Change) - reselection, redirection, active PS HO with data session continuity
SRVCC & enhancement
Location Identification for LBS services
Support for Multicast & Broadcast Services (eMBMS)
VLAN configuration/tagging (IEEE 802.1q) capability at CPE level and support by eNB
No. of VLANs supported per interface (by BSs, CPEs)
Support for IPv6 & Dual stack IP V4 /IP V6
Q in Q functionality support by eNB
TTI Bundling
SPS scheduling
Relay ( L1, L2 & L3 type)
WiFi Public hotspot Integrated services with LTE
Carrier aggregation ( in same & multi band )
RRU Daisy chaining
Cell combination ( Super cell )
Remote GPS
TM9 (CL-SU / MU MIMO & multilayer Beamforming)
4x4 MIMO in Downlink
Hetnet ( interworking of small cells and macro cells )
eScheduler /coordinator
Hotel BBU
Support for VOIP- Class 5 features (Call waiting, Hold, 3 party conferencing etc.) , Call quality with different
TM 7 & TM 8 ( Single layer and Dual Layer Beamforming). Also includes different types of BF like
TM -1 to TM-6 testing which includes SISO, SU & MU MIMO , Diversity , Open & closed loop MIMO for 2
CoMP ( uplink- intra & inter cell )
CoMP ( downlink- intra & inter cell )
Active Antenna Array
SDR ( dual band dual carrier )
EWS system
S1 - Flex
eNB Co Transmission backhauling capabilities ( 4G , 3G & IP Abis)
TOP support on eNB ( 1588v2) & GPS clock Freq. & Phase clock backup
64 Qam Support on uplink
Jumbo Frame support
Robust Header Compression | IP & SCTP transport enhancement
IPv4/IPv6 dual stack & pur IPv6 support
7. eNB Power Consumption ( to be verified for all confiuration type installed in the network)
RRU power consumption in no load condition
BBU power consumption in no load condition
8.Service Recovery timing/behaviour in various outage scenarios
MME
PDN Gateway
Serving Gateway
Transmission
eScheduler/coordinator
9. Interference Supression Techniques ( Functionality will be verified in this section however corresponding gains will be verified as part of cluster or lab testing )
Different Configuration support like TDD splits , Special subframe, Cyclic prefix (short , Long) , Channel
RRU Power in with 50% & 100% load at room temperature ( RRU transmitting at full power in 100%
BBU Power with 50% load & 100% load( BBU loading is determined by CPU load - max users & throughput
Verify Interference mitigation techniques for both uplink & downlink for User traffic
c. enahnced ICIC ( X2 & UE CQI / QOS feedback)
e. FSS ( Frequence slective scheduling - wide band & sub band CQI feeedback based )
Interference Control for Control channels CCO, CCLR, CCIA , Control channel power control
IRC, MRC
Closed Loop and Open loop power control
10. eNB Hardware Test
11. Energy Saving ( This heading covers all Opex saving related features that are developed by Partners and should not restrict to specifc mentioned below)
Automatic PA Shut down ( time based & load based)- Load based power saving
DRX Long & Short ( smart DRX)
RS Power boosting & Cell power reduction for control & traffic channels
DTX
12. Handover ( all handover includes intra & inter cells /RAT type/frequency )
S1 & X2 Handover & delaysIRAT Handover & delays Load based handoverService based HO
Verify the eNB RX sensitivity, Transmit Power, Occupied Bandwidth, Time alignament, ACLR, Filter Rejection, ACS & SEM, Control & Data Channels Powers & RB allocation. OBSAI/CPRI Std measurements
Actual value Pass/Fail
1. Latency Test
2. Throughput and Capacity Test with multiple users
3. RRM
4. QoS & Scheduler Test
a. Document is based on current visibility of features & roadmap, however the scope defined below will be refreshed after mutual discussion, as in when the new releases/features are available and not specified in the list below
c. Functional Testing will be verified in this section however gains quantifications will be done in cluster or lab testing based on agreed test procedure
5. SON
6. Services Test ( Functionality will be verified in this section however corresponding gains will be verified as part of cluster or lab testing )
7. eNB Power Consumption ( to be verified for all confiuration type installed in the network)
8.Service Recovery timing/behaviour in various outage scenarios
9. Interference Supression Techniques ( Functionality will be verified in this section however corresponding gains will be verified as part of cluster or lab testing )
10. eNB Hardware Test
11. Energy Saving ( This heading covers all Opex saving related features that are developed by Partners and should not restrict to specifc mentioned below)
12. Handover ( all handover includes intra & inter cells /RAT type/frequency )
Remark
1. Latency Test
2. Throughput and Capacity Test with multiple users
3. RRM
4. QoS & Scheduler Test
a. Document is based on current visibility of features & roadmap, however the scope defined below will be refreshed after mutual discussion, as in when the new releases/features are available and not specified in the list below
To test paging latency, stationary, target user on cell center/middle/edge under specific load scenario.
Verification that a UE correctly performs a tracking area update (TAU) while moving in idle & acitve mode and correctly re-selects the cell & recird the delay. Also paging delay to be captured
The point named near/middle/far can be define by RSRP and/or SINR. This test can be executed with UE emulator both for uplink and downlink directions. Dnamically CQI changes to simulate different radio scenario is also possible using UE emulator
Each profile would contain a parameter set adapted to the requirements given by the standardized QCI characteristics, this case will offer better service to the customer. Demonstrate QCI1 to QCI 9 characterstics by provisioning multiple traffic streams mapped to different QCI.
To verify the when UE-AMBR switch enable, the UL/DL rate will as close as UE-AMBR UL/DL
To verify that eNB can create Service flows basis on different classification rules as well CPE shall support these service flows.
5. SON
6. Services Test ( Functionality will be verified in this section however corresponding gains will be verified as part of cluster or lab testing )
Verfication of Service quality for each service type to be measure
Bind the Control-, User-, Management- and Synch-plane (MCUS-plane) and their applications to different virtual IP addresses as prerequisite for the functionality VLAN based traffic separation
Verify, that traffic on U-,C-plane and M-plane can be separated on different VLANs and routed via different IPSec (optional) tunnels.
To verify whether traffic flow can be restricted between different SS in a given BS. This is essential to avoid unnecessary flow of packets between SS.
The purpose of this test case is to sort the ANR connected events based on 1. Event object id 2. eNB identity 3. Date and Time of the event creation.
Framework allowing handovers of packet data sessions from E‐UTRAN to GERAN, for GERAN networks that do not support PS handover.
To verify working of class5 voice features
To ensure that the all elements of the system support IPv6
To check whether QinQ functionality is supported
To enhance the system performance
Framework allowing the network to handover a voice call from the IM CN Subsystem (PS domain) to the CS domain of a legacy system .•The function allows to perform a PS to CS domain transfer together with a radio link handover•SR‐VCC handovers supported from E‐UTRAN to UTRAN/GERAN
To verify User and Control Plane supports:- A-GPS, OT-DOA & E-CID; verify accuracy of MS position•OTDOA (downlink positioning method based on measured time differences observed by the UE from different eNode Bs)•A‐GPS (satellite positioning: GPS and similar systems)•Enhanced Cell ID methods
To verify if VLAN can be configured on the BS and CPE and check whether tagging and untagging can be done at CPE
To verify what maximum number of VLANS are supported by equipment.Is it 4096 or less
7. eNB Power Consumption ( to be verified for all confiuration type installed in the network)
8.Service Recovery timing/behaviour in various outage scenarios
EPC coordination
EPC coordination
EPC coordination
Transmission Cable plug out test
9. Interference Supression Techniques ( Functionality will be verified in this section however corresponding gains will be verified as part of cluster or lab testing )
To measure the power consumption of the BS as per the specs on 10% of the sites chosen randomly.
10. eNB Hardware Test
11. Energy Saving ( This heading covers all Opex saving related features that are developed by Partners and should not restrict to specifc mentioned below)
12. Handover ( all handover includes intra & inter cells /RAT type/frequency )
LIST_x000D_AXGP S1 MVI Test List for ZTE Phase2 21 (21)
Prepared: NRJ/ON/XV Shinya MaeharaDate: 2011-06-13
Sheet: VT -Part2 (Cluster & NW AT)Ericsson Confidential
No: 5/153 82-5/FCP 121 7024 Uen_x000D_Rev: PA1
Cluster Field & Optimization Testing
Test Case ID Description Remarks
1. Coverage Tests
Cov-Qual01 %age of samples within the specified values and comparision of predicted vs actual coverage stats
Cov-Qual02 50% loaded scenario to be analyzed
Cov-Qual03 Extensive drive test & OSS parameters fetching to benchmark the cluster performance as per agreed network & service KPIs
Cov-Qual04 Record Average & Peak cell DL & UL throughput for single UE & Multiple UE- Uni & Bidi Data FTP throughput testing
2. Interference Test
Field-INT01 Verify Interference mitigation techniques gains for each feature available for interference supression by conducting cluster wide drive test
Field-INT02 eScheduler/Coordinators based scheduling control
3. Open Loop & Closed Loop, Synchronization, etc
Field-PA01 Record performance for closed Loop and open loop power control & MIMO scenarios in cluster drive test
Field-PA02 Record cluster performance degradation on account of Loss of eNB GPS synchronization
Field-PA03 Record cluster performance for different TDD configuration
4. Handover Test
Field-HO01 S1 Handover- Inter MME / S-GW if applicable
Field-HO02 X2 Handover
Field-HO03 Data session continuity at different mobility speeds ( it should cover multiple TAU, S-GW, MME, serving scenarios as applicable)
Field-HO06 Bidirectonal TCP & Uni-direction uplink & downlink drive test , includes intra-site, inter-site X2 and S1 HO scenarios
Field-HO07 Downlink TCP service handover with speed 30 km/hr,50% DL loaded network, includes intra-site, inter-site X2 and S1 scenarios
Field-HO08 Data Session mobility support (60kmph, verify max speed supported): inter-eNB handovers. To check that data session is maintained while moving between eNBs
Field-HO9 Intra/Inter-eNB handovers success | Inter & Intra frequecny & RAT type HO success
Field-HO10 Performance statistics for cell re-selection & re-direction in acitve and idle mode, active PS handover Based on Drive test
5. Feature Test Gains quantification - Detail testing of pilot features to quantify the gains as per feature availability and agreed procedure
Note:-a. Cluster should be identified with mix cnfiguration of eNB to execute the following tests however not limited to the following testcases b. Pass/Fail criterion of each test to be mutually discussed/agreed and to be included in the VT test document submitted by Partnerc. Gains quantifications/performance statistics to be captured in the cluster testing as per agreed test procedures
These tests to be performed on the cluster after optimization of the various parameters and turning on all the relevant features.Performance to be analyzed by by simulating serving & adjacent cell loading ( 50% ) on both DL and UL . Drivetest route and stationary testing need to be performed on prior agreed test plan. Key parameters to be measured .Tests need to be repeated for device mix from various OEMs.
• Tests to be repeated for devices from different OEMs• In the first cluster tests to be performed for different TDD configuration & different loading condition as required by Bharti
% samples of SINR, RSRP, Throughput , MCS, MIMO (SM & Diversity) as per required boundary conditions and identifiy the acceptable Rx levels.
Atleast 1000 stationary point testing at indoor/outdoor locations as per prescribed formats to correlate SINR, RSRP, Throughput, clutter/penetration loss variations in the unloaded and loaded scenario
Gains due to the different mitigation techniques should be clearly measured and recorded
To test the mobility and handover performance within 0% & 50% load scenario
To test the mobility and handover performance within 100% load trial cluster.
top related