Standard 7:
Institutional Assessment
The institution
has developed and implemented an assessment process that evaluates its overall
effectiveness in achieving its mission and goals and its compliance with
accreditation standards.
Relative to this standard, an accredited institution is expected to possess or
demonstrate the following attributes or activities:
1a. a foundation in the institution’s mission and clearly
articulated institutional, unit-level, and program-level goals that encompass
all programs, services, and initiatives and are appropriately integrated with
one another (see Standards 1: Mission and Goals and 2: Planning, Resource
Allocation, and Institutional Renewal);
1b. systematic, sustained, and thorough use of multiple
qualitative and/or quantitative measures that:
1b1. maximize the use of existing data and information;
1b2. clearly and purposefully relate to the goals they
are assessing;
1b3. are of sufficient quality that results can be used
with confidence to inform decisions;
1c. support and
collaboration of faculty and administration;
1d. clear
realistic guidelines and a timetable, supported by appropriate investment of
institutional resources;
1e. sufficient
simplicity, practicality, detail, and ownership to be sustainable;1f. periodic evaluation of the effectiveness and
comprehensiveness of the institution’s assessment process;
The state’s long range plan, A Blueprint for Excellence - New Jersey’s Long-Range Plan for
Higher Education Update 2005 (#26), provides the broad parameters for
As was documented in standard
2 (#R16),
An important assessment function
played by the state is through its review of the university’s annual budget
request to ensure that the university is efficiently and effectively utilizing
its resources (see standard 3, element 1
(#R21)). The university also submits an annual Accountability Report (#135)
to the state that contains evaluative data on the university’s performance in
areas such as student access, educational outcomes and instructional delivery.
At the university level,
institutional assessment at
Campuswide faculty councils also provide an advisory role to the President and the senior administration of the university. (see standard 4, element 1 (#R24))
While the President’s
strategic goals provide a broad approach to institutional assessment at
A fundamental mechanism for
moving the university along the road to achieving these goals is the All Funds
Budgeting (AFB) process adopted by the university in 2004-05 academic
year. Under the direction of the
Executive Vice President for Academic Affairs and the Vice President for
Budgeting, AFB supports the transparent distribution of institutional
resources. It is consistent with
Because AFB is a heavily
tuition-driven model it is important for deans to have access to data that accurately
tracks their enrollment and course credit data (see diagram (#519) of how tuition
dollars are allocated). These data are
critical planning elements for the units and are contained in the data
warehouse maintained by Institutional Research.
The following are examples of the data used (view1 (#520); view2 (#521)). The Office of Budget and Resource Studies
works with unit deans to provide relevant budget information that assists the
units in the development of their unit priorities, revenue projections, and
faculty hiring projections. These plans
are developed, discussed and assessed in regular meetings with the Executive
Vice President for Academic Affairs.
The Center for Organizational
Development and Leadership (#522) (ODL) provides a critical dimension
to assessment activities at
Another
major effort of institutional assessment has been the effort to assess and
better understand the way the university is perceived by its many different
constituencies. The first step in this
process was the University Relations Constituency
Study (#88), which provided the basis for a process of continual
assessment of how
A Matrix of Education Support
Technology (#261) provides an overview of goals for education support
technology at
The Office of Institutional Research and
Academic Planning (OIRAP) (#532)
gathers, analyzes, and uses data to inform institutional planning, policy
development and decision-making. The
Office provides reporting, assessment, benchmarking, planning, and public
information services to support institutional effectiveness and to respond to
the needs of the university community and the citizens of
As an active
member of the American Association of Universities Data Exchange, Institutional
Research collaborates with respective offices of other member schools of the
Association of American Universities (AAU) to develop a set
of comparative indicators (#536) for both undergraduate and graduate
education. The development of these
indicators will be used (#537) by the AAU and
its member schools to not only facilitate internal assessment of institutional
effectiveness, but provide critical information about institutional performance
to external stakeholders. Many of these
indicators are planned to be ready for use by the individual AAU institutions
in spring 2008.
A selection of regular and ad hoc reports used for institutional assessment and produced by OIRAP include studies on student economic (#538) and racial/ethnic (#539) diversity; student retention and graduation rates (#540); periodic Economic Impact Statements (#541); reports to the NCAA (#489) and Department of Education concerning athletics for each campus (New Brunswick(#543), Newark (#544), and Camden (#545)); Title II – Annual Questionnaire on Teacher Preparation Programs (#492); and Legislative District Summaries (#547).
When opportunity presents itself,
the office works closely with outside organizations engaged in researching
important topics in higher education.
Two recent efforts have resulted in efforts to comparatively evaluate
the success of
Through its data warehouse (#550), OIRAP is able to provide information to central administrators and the many decanal units of the university and conduct special analytical studies on a need to know basis. The data warehouse contains diachronic and current information on students, faculty, and staff (#551). The information included in the data warehouse comes from various university legacy data systems, such as the Student Records Database (SRDB), Human Resources, Course Scheduling, and the Course Analysis System (CAS), as well as the state's Student Unit Record Enrollment (SURE) database. Other sources of data include student placement data from the College Assessment Research System (CARS) and faculty information from the Faculty Survey. Data from the new Student Financial Aid system and data from the Office of Research and Sponsored Programs is also planned to be incorporated into the system. Entry into the data warehouse can occur through different access points (direct querying, On-Line Analytical Programming (OLAP), etc. – see linked diagram (#552). Examples of the type, level and detail of the data that are available from the data warehouse can be found in the linked file (#553) of selected data views. The data warehouse also contains the source data for the all funds budgeting system (see standard 2, element 2 (#R4)).
OIRAP collects
information on faculty activities through its management of the Rutgers Faculty Survey
(#555). The Faculty Survey provides
faculty with a single point of data entry for all their required data reporting
needs such as tenure and promotion forms and grant application forms. Reports of faculty activity are available to
deans and other administrators (see link for an example of a report
at a Dean’s level (#556)). In
addition, OIRAP collects and produces reports on instructional workload
activity at
OIRAP engages in an active survey research program, which provides a rich source of primary data on students’ assessment of their academic and student life experiences. The office regularly administers the Upper Division (558) and Graduating Student (#559) Surveys. These and other surveys (see listing of undergraduate student surveys (#560)) have informed decision-making activities including the Transforming Undergraduate Education initiative, student services improvements, the proposed revision of the student code of honor, etc. Graduate student surveys including the Ph.D. exit survey (#561) are used by graduate programs as an essential assessment tool. Surveys of faculty and staff have also been administered to help inform decisions on a variety of topics including faculty service (#562), undergraduate research (#563) and learning outcomes (#564), global and international initiatives (#565), academic integrity (#566), and campus climate concerns (#567).
Other institutional
assessment-related activities of the office include:
·
overseeing the development
of new programs (#60), which has recently been revised to include
specifications for assessing learning outcomes in the development of new
programs
·
providing staff
support for the Committee on Academic Planning and Review (see standard 2, element 2 (#R7))
·
administering the testing and placement program (#570) of incoming students and reporting on the effectiveness of the program (#571) functioning
as the university liaison to the Association
of American Universities Data Exchange (#572), an organization that
collects and exchanges benchmark data on institutional effectiveness among
member institutions (a description and list of data exchange items available to
participating members can be found here(#144))
·
coordinating the university’s
participation in national surveys such as the Cooperative Institutional
Research Program (#574) (CIRP) and the National Survey of Student
Engagement (NSSE) (#575)
·
managing
university reporting to national agencies such as the U.S. Department of Education (#576) (e.g., IPEDS (#577)); state agencies such as the Commission on Higher Education
(#578) and the Department of Education; NCAA – athletic
progress reports (New
Brunswick (#579), Newark
(#580)); and college guides (e.g., U.S.
News (#581), CDS
(#482), Peterson’s (#583))
3. written
institutional (strategic) plan(s) that reflect(s) consideration of assessment
results.
The incorporation of assessment
results that reveal their discussion with constituents in written plans and
improvement efforts can be found in standard 2, element 2 (#R13).