Phoenix Seminary Building

About Us >

Assessment

Phoenix Seminary Assessment Philosophy

“Assessment” is a term used in higher education to refer to an extended and on-going process of self-evaluation intended to establish for a school and the public that its educational programs are effective.  Assessment data are used to improve courses, curricula, academic programs, and many aspects of an institution’s life and practices.  All accredited institutions of higher learning engage in assessment activities.

Phoenix Seminary embraces intentional, on-going assessment of our institutional effectiveness as a tangible manifestation of our commitment to Christian integrity and stewardship.  To this end, we seek to be an institution wisely using the resources God entrusts to us by becoming increasingly proficient and professional in accomplishing our mission

Because of this philosophy, the Board, administration, faculty and staff of the Seminary have for many years engaged in various kinds of analysis of our effectiveness.  Our 2011-12 Comprehensive Assessment Plan reflects commitments to best practices embodied in the standards of our two accrediting agencies:  The Association of Theological Schools (ATS) and the Higher Learning Commission (HLC).

The Seminary Board evaluates its own effectiveness and thereby provides a positive example for pursuing assessment in all the school’s operational departments and administrative functions as well as focused evaluation of its effectiveness in facilitating student learning outcomes.  The assessment activities of the Seminary are overseen by the Director of Assessment working with the Academic Dean and the Assessment Committee—composed largely of full-time resident faculty and academic administrators.  This arrangement helps ensure that all departments remain focused on our educational mission.

Because we are committed to transparency, the following downloadable material covers virtually all of our assessment process including:  Student Learning Outcomes; Our Comprehensive Assessment Plan; Listings of our Assessment Resources; Our Current Assessment Activities (and associated calendars); Evidence of student learning displayed in annual summaries of outcomes assessment for each academic program; and Indications (in annual summary) of how assessment results are being used to improve our educational effectiveness.  Those who seek additional information, have questions, or wish to make comments may contact the Seminary’s Director of Assessment, Roma Royer, who may be reached at (602) 850-8000, Extension 111 or by email at:  rroyer@ps.edu.

The nature and scope of assessment at Phoenix Seminary is indicated in the table of contents of our current year Comprehensive Institutional Assessment Plan:

Table of Contents - 2011-12 Assessment Plan

Phoenix Seminary Assessment Committee

2011-12 Members: Joshua Anderson; Roger Ball; Fred Chay; Malcolm Hartnell; W. Bingham Hunter (Academic Dean); Doug Olbert; Roma Royer (Chair and Director of Assessment); Justin Smith; Paul Wegner.

Description: The Assessment Committee works in cooperation with the Director of Assessment to plan, implement, and evaluate the assessment activities of the Seminary and to document improvements made as a consequence of the institution’s assessment activities.  From time-to-time, the Seminary faculty, acting as a committee of the whole, function as the Assessment Committee, particularly in regard to discussion and development of learning outcomes, assessment instruments, evaluation criteria and rubrics, as well as discussion of areas for change/improvement identified through the assessment process. The Assessment Committee is charged with the following:  (a) Approval of assessment program goals as reflected in the annual assessment plan; (b) Oversight of the assessment process, including implementation and completion of the assessment loop each academic year; (c) Assessment of the assessment plan; and (d) Decisions regarding management of assessment materials.

Assessment Purpose and Goals at Phoenix Seminary

Purpose of Assessment: To improve the Seminary by providing data for the planning, development, continuation and improvement of quality academic, administrative, operational and student services functions.  Data collected are utilized to initiate necessary change in institutional governance, budgeting, strategic planning, administration and operations, academic programs, student support services and programs.  Assessment activities also ensure that the Seminary has meaningful data for evaluation of its stewardship of resources, integrity, ability to accomplish its mission and service to the public.

Goals of Assessment:

  • To ensure Christian integrity and effective stewardship
  • To become increasingly effective and professional in realizing our educational mission
  • To improve student learning and their professional and spiritual development
  • To enhance our curricula and instruction
  • To align strategic planning, assessment, and budget requirements
  • To foster compliance with the requirements for accreditation
  • To demonstrate compliance with applicable Federal Regulations

2011-12 Assessment Plan

Each year the Seminary’s Assessment Committee reviews the findings of the prior year Assessment Plan.  The effectiveness of the plan itself and associated instruments are evaluated and changes made as analysis of data and experience indicate is necessary.  Evaluation of the plan itself normally takes place in the fall semester, hence the website displays the prior year’s plan until the current year’s plan is approved by the Assessment Committee and the Board of Directors.  This is usually done at the Board Retreat in mid-November.

Links to Elements of the Current Academic Year Comprehensive Assessment Plan:

The Phoenix Seminary 2011-12 Comprehensive Assessment Plan is a large document.  The entire plan, divided into several parts, is available as PDF’s through the links indicated below.  The basic plan may be accessed through the following link:

2011-12 Phoenix Seminary Comprehensive Assessment Plan

Academic Assessment:

The Seminary seeks, in God’s grace, to produce graduates who have the knowledge, skills and character qualities essential to effective ministry.  These are summarized in our Profile of a Graduate. Each academic program at Phoenix Seminary is linked to the Profile through alignment of degree program outcomes and individual course learning outcomes.  These relationships are laid out in the following pages from our assessment plan:

Profile of a Graduate and Degree Program Student Learning Outcomes

Profile of a Graduate Alignment to Student Learning Outcomes and Curriculum Maps

Assessment takes place in a planned cycle, with outcomes evaluated according to calendars, using instruments and various tools.  These are explained in the following pages from our assessment plan:

Assessment Cycle Calendars and Instruments

The seminary’s academic programs are each assessed using criteria linked to the Profile of a Graduate. The academic assessment template and assessment plans (which also serve as records) for each degree or diploma program are given on the following pages from our assessment plan:

Academic Program Assessment Plan Template

Academic Program Measures and Assessment Plans

Non-Academic Assessment:

Although traditional educational assessment focuses on student learning in academic programs, at Phoenix Seminary we also apply assessment criteria (to foster better service and incorporate best practices) in all major areas of Operations and Administration.  Departments and offices use a template similar to that  employed in academics, adapted to the specific activities of each area.  2011-12 Operations assessment plans may be examined in the following pages from our assessment plan.

Administration Assessment Plan Template

Operations Assessment Plans 2011-12

Prior Year Assessment History:

Phoenix Seminary maintains records of prior year assessment activities.  These provide useful comparative data to the Assessment Committee and an archive for accreditation purposes and public examination.  Because of the size of these historical records, they are not all posted here.  Those not posted may be consulted by appointment with our Director of Assessment .

  • The 2007-08 Comprehensive Assessment Plan is available on request.
  • The 2008-09 Comprehensive Assessment Plan is available on request.
  • The 2009-10 Comprehensive Assessment Plan is available on request.
  • The 2010-11 Comprehensive Assessment Plan is available on request.
  • The 2011-12 Comprehensive Assessment Plan appears in segments above. This plan includes 2010-11 assessment results as “historical data” for comparison, as approved by the Assessment Committee, including summaries of data analysis, recommended changes for each academic program, and a task list for follow-up accountability. 2010-11 assessment results may be viewed by clicking on the link below:

2010-11 Assessment Results

Resources

Current Phoenix Seminary Faculty Rubrics:

To assist in ensuring greater objectivity in evaluating student work, seminary faculty have developed a number of rubrics.  A “rubric” is a scoring tool listing the requirements for a research paper, other course assignment, or examination.  Typically, rubrics break an assignment into a number of parts and indicate performance criteria for the several elements.  Rubrics are valuable educationally because they convey useful feedback to students and encourage student learning.  They are important to students because they define expectations, provide performance criteria and increase objectivity in evaluating student work.  They are especially important to faculty in contexts such as an oral examination, where multiple examiners or jury members render decisions about a student’s competency in responding to questions.  In such contexts, rubrics provide greater “inter-rater reliability.” That is, they reduce subjectivity among the examiners opinions because the criteria for evaluation are spelled out, and consequently their use tends to produce greater consensus regarding student performance.  The following document contains examples of rubrics used at Phoenix Seminary.

Examples of Phoenix Seminary Rubrics

On-line Assessment Information:

Books on Assessment:

  • M. J. Allen, Assessing Academic Programs in Higher Education,(Bolton, MA: Anker Publishing, 2004).
  • A. Driscoll, D. Cordero de Noriega and J. Ramaly, Taking Ownership of Accreditation:  Assessment Processes That Promote Institutional Improvement and Faculty Engagement, (Sterling, VA: Stylus, 2006).
  • Judith Grunert, Barbara J. Millis and Margaret W. Cohen, The Course Syllabus:  A Learning-Centered Approach,2nd edition, (San Francisco, CA: Jossey-Bass [Wiley imprint], 2008).
  • William R. Meyers, Closing the Assessment “Loop”:  Nurturing Healthy, On-going Self-evaluation in Theological Schools, (Chicago, IL: Exploration Press, 2006).
  • Peggy L. Maki, Assessing for Learning:  Building a Sustainable Commitment Across the Institution, (Sterling, VA: Stylus, 2004).  [An American Association for Higher Education (AAHE) publication].
  • C. A. Palomba and T. W. Banta,  Assessment Essentials:  Planning, Implementing, Improving,(San Francisco:  Jossey-Bass, 1999).
  • Dannelle D. Stevens and Antonia J. Levi, Introduction to Rubrics:  An Assessment Tool to Save Grading Time, Convey Effective Feedback and Promote Student Learning, (Sterling, VA:  Stylus, 2005).
  • Linda Suski, Assessing Student Learning:  A Common Sense Guide,2nd edition, (San Francisco, CA:  Jossey-Bass, 2009).
  • Barbara E. Walvoord, Assessment Clear and Simple,(San Francisco, CA:  Jossey-Bass, 2004).
  • Barbara E. Walvord and Virginia J. Anderson, Effective Grading:  A Tool for Learning and Assessment in College,  2nd edition, San FRancisco, CA:  Jossey-Bass, 2009).