Software EngineeringLab Session

Session 4 – Feedback on Assignment 1

© Jorge Aranda, 2005

Overview (Shorter) round of feedback on

Assignment 3

Assignment 4

PSP1

Results from Assignment 1

Note on tutorial next week

New insights/opinions to report? Feedback on each aspect of the

assignment: The actual programming task (no PSP) The Project Plan Summary Time and Defect Logs – any changes? Other documents for the assignment Impressions on the PSP in general

Assignment 4 Calculate the linear regression size-estimating parameters

for a set of n programs. What???

If you don’t understand these requirements, you probably haven’t read the required chapters! You should have gone all the way to Chapter 6 already. Go back and read them. Section A7 will help as well.

Basic idea: To use the PROBE estimation method (more on this later), you’ll need two parameters that you enter into a formula. Calculating them by hand is a pain

So we’re building a tool that will do that for us

Assignment 4 Assignment 4 uses PSP1

Very similar to PSP0.1, except because now we’re attempting to have more solid estimates

You should have nailed down time and defect tracking by now, so focus on getting the estimation method right!

PSP1 Only big difference: Size Estimating Template and

the PROBE method We won’t go over it all in this tutorial Basic idea: if your estimates and your actual

performance are correlated, then finding the linear regression factors between both data sets, and using them for your new estimate, will produce more accurate results

Until now, the only estimates we have produced are LOC numbers and Estimated Time numbers.

We’ll start estimating the number of functions that our program needs to work, but the advantages of these estimates will only show up later in the process

Highly recommended that you follow tables C35 and C36 from the Humphrey book

Results from Assignment 1 In general, high marks: Average 83.9

Some of you have special marking notes (R1, T2, etc.) Check Paul’s list of notes at

http://www.cs.toronto.edu/~jaranda/csc444/assig1notes.html

What to do if you’re unhappy? First, cool down and check whether you’re sure we made a mistake

If you think your grade is incorrect, write a remarking request stating: Your name and student number Your case (why do you think your mark is incorrect?)

Give me your remarking request, along with your assignment, at the start of our next tutorial session

Note that if you do this, the marking TA will remark your full assignment.

Results from Assignment 1 Average estimate: 186 minutes

Perhaps because you were told one of these assignments usually takes 2-4 hours?

Average real total time: 271 minutes About 1.5 hours more than the average estimate

Average overrun: 58%

Average number of defects found: 9

Results from Assignment 1 Before you see the following charts,

REMEMBER: You are not being marked for accuracy of

estimates You are not being marked for actual time spent You are not being marked for number of

defects found This is not a programming competition

Results from Assignment 1

Estimates

0.0%

5.0%

10.0%

15.0%

20.0%

25.0%

30.0%

35.0%

0-30

31-6

0

61-9

0

91-1

20

121-

150

151-

180

181-

210

211-

240

241-

270

271-

300

301-

330

331-

360

361-

390

391-

420

421-

450

451+

minutes

Results from Assignment 1Actual Times

0.0%

5.0%

10.0%

15.0%

20.0%

25.0%

30.0%

35.0%

0-30

31-6

0

61-9

0

91-1

20

121-

150

151-

180

181-

210

211-

240

241-

270

271-

300

301-

330

331-

360

361-

390

391-

420

421-

450

451+

minutes

Results from Assignment 1Estimates vs. Actual Times

0.0%

5.0%

10.0%

15.0%

20.0%

25.0%

30.0%

35.0%

0-30

31-6

0

61-9

0

91-1

20

121-

150

151-

180

181-

210

211-

240

241-

270

271-

300

301-

330

331-

360

361-

390

391-

420

421-

450

451+

minutes

Results from Assignment 1Overrun %

0.0%

5.0%

10.0%

15.0%

20.0%

25.0%

30.0%

35.0%

<-50

%

[-50

-20

%]

[-19

+9%

]

[+10

+39

%]

[+40

+69

%]

[+70

+99

%]

[+10

0 +1

29%

]

[+13

0 +1

59%

]

[+16

0 +1

89%

]

[+19

0 +2

19%

]

[+22

0 +2

49%

]

250%

+

Results from Assignment 1Average time percentage per phase

Planning8%

Design9%

Code38%

Compile9%

Test25%

Postmortem11%

Results from Assignment 1Jorge's numbers

Planning21%

Design9%

Code32%

Compile0%

Test32%

Postmortem6%

Student A Numbers

Code20%

Compile7%

Test64%

Planning5%

Design0%

Postmortem4%

Student B Numbers

Code26%

Compile3%

Test14%

Postmortem13%

Design28%

Planning16%

Student C Numbers

Code37%

Compile4%

Test18%

Planning0%

Design0%

Postmortem41%

Results from Assignment 1Number of Defects

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

0 1-4 5-8 9-12 13-16 17-20 21-24 25-28 29-32 33+

Note on tutorial next week Next week is the midterm, and during the tutorial

session there will not be new content

However, if you… have read up to Chapter 6 of the book, have tried to do the PSP1 estimation process on your

own,

… and still can’t work it out, I’ll be here 6-7pm to help you find out if you’re doing something wrong.

But no answers if you haven’t done your job!