Developing Engineering Education Publications through Teaching and Service Activities

Kevin Dahm, Rowan UniversityTuesday, November 10, 2015

Evolution of a Journal Publication

Grant Proposa

lProject Publish

Results

Two challenge-based laboratories for introducingundergraduate students to biomaterials

Jennifer Vernengo and Kevin Dahm, 2012

Education for Chemical Engineers

Elements of Paper Introduction/Lit Review on the importance of

biomaterialsBackground/Lit Review on the pedagogical

rationale for using laboratory-based projectsProject descriptions

ScenariosMaterialsProceduresGrading

AssessmentsPre/Post quizzesMapping of quiz questions to ABET outcomesFinal Exam questions, control vs. experimental

Jennifer Vernengo

Joined Rowan in Fall 2009Technical expertise in Biomaterials

Two initial teaching assignments:

Freshman Engineering Clinic- project-based interdisciplinary introduction to engineering

Senior/Graduate elective course in own area of specialization

Biomaterials Laboratories

Freshman Engineering Clinic: Students make bioactive ceramics and measure

their toughness

Introduction to Biomedical Materials:Literature review project incorporated into first

offeringOpen-ended laboratory project on hydrogels

developed for subsequent offerings

Elements of Paper Introduction/Lit Review on the importance of

biomaterialsBackground/Lit Review on the pedagogical

rationale for using laboratory-based projectsProject descriptions

ScenariosMaterialsProceduresGrading

AssessmentsPre/Post quizzesMapping of quiz questions to ABET outcomesFinal Exam questions, control vs. experimental

Elements of Paper Introduction/Lit Review on the importance of

biomaterialsBackground/Lit Review on the pedagogical

rationale for using laboratory-based projectsProject descriptions

ScenariosMaterialsProceduresGrading

AssessmentsPre/Post quizzesMapping of quiz questions to ABET outcomesFinal Exam questions, control vs. experimental

Elements of Paper Introduction/Lit Review on the importance of

biomaterialsBackground/Lit Review on the pedagogical

rationale for using laboratory-based projectsProject descriptions

ScenariosMaterialsProceduresGrading

AssessmentsPre/Post quizzesMapping of quiz questions to ABET outcomesFinal Exam questions, control vs. experimental

Final Exams as Assessment InstrumentTwo cohorts

Lit review project on hydrogelsLab project on hydrogels

Two common final exam problemsOne on hydrogelsOne control question

Solutions from both cohorts given to Kevin with no identifying information except a number.

Kevin evaluates solutions without knowing which cohort each individual is in

Rubric for Evaluation of Final Exam Solutions  4 3 2 1

Student identified process involved in

making polyvinyl alcohol (PVA)

hydrogels and was able to apply to new

scenario, cardiac tissue engineering

Shows clear understanding by mentioning two or

more variables specific those

discussed for PVA hydrogels, such as

polymer concentration, number and

duration of freeze thaw cycles,

molecular weight, etc

Student was able to

identify only one variable specific to

PVA

Student did not mention

any variables specific to PVA, but

mentioned general ways

of varying polymer

properties

Student displayed no knowledge of

hydrogels and how to

design them

Student understands general concepts on

mechanics of elastomeric

materials, especially those natural

elastomers found in the body

Student identified properties of elastomeric

materials (flexibility and extensibility)

Leaves out some minor aspects of elastomeric

tissue mechanics

Has difficulty in discerning

between elastomers and other materials

Has displayed no knowledge in

this area

Assessment Results

Cohort # students Avg. RatingHYDROGEL

Avg. RatingCONTROL

Lit Review 17 3.17 3.63Laboratory 18 3.70 3.54

Competition between student groups in the proteinproduction challengeBrian Lefebvre, Loren Connell and Kevin Dahm,

2009Elective in Bioprocess Engineering created by new

faculty member2005 course involved a literature review project2006/2007 offerings incorporated the “Protein

Production Challenge”

Baseball Stadium Design: Teaching Engineering Economics and Technical Communication in a Multi-Disciplinary Setting

K. Dahm and J. Newell, 2001

Sophomore Engineering Clinic: team-taught interdisciplinary course on technical communication and engineering design

Implementing and Assessing the Converging-Diverging Model of Design in a Sequence of Sophomore ProjectsCourse had an existing design project on design,

construction and testing of cranes

Faculty team implemented a new course organization that included a recently published model for the design process

Used student performance on the design project as an assessment instrument

Grading Rubrics for Design ReportsIndicator Score

4 3 2 1Prepares a

technical report with content

appropriate to audience

Considers audience fully. Report is

exactly geared to correct audience

Considers audience well, but may have a

few moments of inappropriate level

Tries to consider audience but may

over- or underestimate technical level

Gives little or no regard to the

audience

Presents summarized

results based on analysis of

measurements

Provides clear, complete, correct,

and concise analysis. Does not

present uninterpreted data

Results are well summarized. Little or no uninterpreted data. Major points are covered. A few minor errors may

occur.

Some interpretation and summary is

made, but significant data is missing or left uninterpreted.

Students present data

incorrectly with little or no

interpretation.

Describes in appropriate detail the experimental procedures used

Procedures are clear and succinct.

Procedure is clear, but perhaps a bit

short or wordy

Procedure is complete but

difficulty to follow. Inappropriate detail level is presented

Procedure is incorrect or incomplete

Uses appropriate methods to

estimate and interpret error

Present correct and detailed error analysis and explains its relevance

Presents correct error analysis but

does not fully elaborate on its

importance

Attempts to address errors but is lacking

in procedure or consistency

Makes little or no effort to

address experimental

error

Technical Merit of Crane Design

“Performance” is an objective measure of how “good” the student design

“Performance” of 2005 cranes was significantly better than that of 2004 cranes, according to the 2004 “Performance Equation”.

ABET Accreditation Criteria

EC2000 contained new outcomes-based criteria

Programs tasked withEstablishing objectives and outcomesProviding evidence that these were attained

Emphasis on continuous assessment and continuous improvement

Publications on Assessment

K. Dahm, “Combining the Tasks of Grading Individual Assignments and Assessing Program Outcomes in Project-Based Courses,” Journal of SMET Education, 15, 1 (2014).

J. A. Newell, H. L. Newell, K. D. Dahm, "Rubric Development for Assessment of Undergraduate Research: Evaluating Multidisciplinary Team Projects," Chemical Engineering Education, 37, 3 (2003).

J. A. Newell, H. Newell, and K. D. Dahm, “Rubric Development and Inter-Rater Reliability Issues in Assessing Learning Outcomes,” Chemical Engineering Education, 36, 3 (2002).

Summary

Publications on educational innovations can often be produced with modest time investment beyond the work you would have done anyway.

Assessment needed for publication can often be integrated with the task of grading, if you have rubrics or other instruments designed to enhance the specificity and objectivity of grading.