test and verification solutions121 st april 2010 integrating ethernet cms with internal verification...

Test and Verification Solutions 121st April 2010

Integrating Ethernet CMS with Internal Verification Environments

Cadence Verification Challenge, Bristol,

Mike Bartley, TVS

219 April 2023Test and Verification Solutions 221st April 2010

Overview

• Background– The DUT– The verification environments

• Experiences – Of integrating verification environments and results– Of OVM scoreboard

• Results


The DUT: Blocks from Gnodal Ethernet chip

PCS

MACMedia

Access Control

Sublayer

Physical Coding

Sublayer

Data Link Layer

(Layer 2)

PHY Layer

(Layer 1)

Blocks from an Ethernet chip from Gnodal


Internal block level verification flow

• Use of PSL + IFV• Test bench

– SystemC (sequencers and transactors)– PSL assertions in the design– SystemC coverage and assertion checks– SV covergroups and assertions

• There are numerous simulator tools/languages– It makes sense to pick the right tool for each job– For example

• PSL/SVA and SV covergroups are great for checking internal stuff in the guts of the design, in an unobtrusive way

• Whilst e and SC are good for the higher-level test control…– Need to consider re-use too (Gnodal had SystemC chip test bench)


Description of the internal test bench

PCS

Loopback- Injects clock and lane

skew

stimulus

transactor

Scoreboard

SystemC

Verilog

KEY

CPU

SystemVerilog

PSLPSL

irun

IFV

Coverage

Assertionchecks

Coverage

Assertions


Description of the internal test bench

MAC

SystemC

Verilog

KEY

CPUScoreboard

stimulus transactor

stimulus transactor

PSL

Coverage

Assertions

SystemVerilog

PSL

irun

IFV

Coverage

Assertionchecks


Description of the CMS test bench

eVCincl coverage& assertions

SystemC

Verilog

KEY

OVM eScoreboard

e

PCS

MAC

Loopback- Flow control

CPUSystemVerilog

Coverage

Assertions

irun

Coverage

Assertionchecks


Experiences of using the Ethernet eVC/CMS

• Connecting the eVC – Quick and easy

• Extensive assertions related to IEEE specification• Extensive coverage targets related to IEEE spec

– Comprehensive and easy to adapt to our needs (using VManager)

• Tests– Obtained reasonably good coverage out of the box– Easy to add additional tests

• Injecting errors where we wanted– Layered approach – but we could only see how to inject errors

after packet construction– This made it hard to cover all the state machines which required

error injection at specific times/ in specific sequences


OVM e scoreboard : Instance and connect

1. Define new scoreboard type and declare its ports

unit vr_enet_scbd like ovm_scoreboard {scbd_port in_packet: add vr_enet_packet;scbd_port out_packet: match vr_enet_packet;

};

2. Connect it to the environment monitor/s

extend vr_enet_env {scbd : ACTIVE vr_enet_scbd is instance;connect_ports() is also {

do_bind …..}

};


OVM scoreboard : Add and match

3. Customize the packet add and match criteria

unit vr_enet_scbd like ovm_scoreboard {

in_packet_predict (pkt : vr_enet_packet) is only {

-- Add as UNCERTAIN;

};

out_packet_reconstruct (pkt : vr_enet_packet) is only {-- Perform checks, match in scoreboard

};

extend vr_enet_env {

// add tcm to monitor inputs and update packet status

// from UNCERTAIN to PENDING if appropriate

};


Experiences of using the OVM e scoreboard

• Easy to import and adapt• Predicting which packets get dropped is hard

– Ethernet can silently drop packets!– Difficult to align with packet boundaries from eVC– The DUT has windows of time for errors

• We may or may not lose the link

• We therefore slackened off the scoreboard– With the risk of missing errors


Integrating verification environments in VManager

Apply internal

perspective

Internal vsif file

CMS vsif file

Merge vsif files

Target vsif file


Integrating verification results using VManager

Internal vsof files

CMS vsof files

Merge

Single vsof file


Results

Cvge Statement

Expression

Toggle CMS functional

Gnodal functional

CMS 88% 73% 40% 92% 28%

Gnodal 100% 95% 91% NA 76%

Combined 100% 95% 91% 92% 76%

Setup Run tests Add checks

Review coverage and add tests

Signoff coverage holes

Effort 25% 5% 35% 25% 10%

Time 10% 40% 15% 30% 5%

• Mutation– The designer inserted a number of bugs in the design– The test bench found them all

Coverage low because MAC in static cfg

Coverage low because did not merge in MAC cvge


Conclusions

• The eVC was easy to install and connect• Comprehensive assertions related to IEEE spec• The CMS functional coverage targets

– Comprehensive and easy to adapt for our perspective – Easy to integrate with our coverage targets (VManager)

• The CMS tests– good coverage and were easy to extend

• Ethernet scoreboarding is hard to predict• Easy to merge CMS and internal coverage

– Merge functional and code coverage

test and verification solutions121 st april 2010 integrating ethernet cms with internal verification...

Documents