Postecondary AI Needs Assessment
A resource to help states assess local capacity

Post

Determining a Postsecondary Institution’s Capacity to Integrate AI 

The Commission on AI in Education’s recommendation on local capacity is accompanied by two model questionnaires. SREB staff developed these to help states develop assessments and begin determining the capacity of school districts or institutions of higher education.  

These questions are intended to gauge critical pieces of the K-12 implementation puzzle such as technology infrastructure, staff capabilities, student needs and planning. 

States should consider creating scoring rubrics for the questionnaires that would help determine recommendations regarding the level of help, assistance needed and specific actions steps going forward. 

Sample recommendations and potential next steps for states to support districts follow the questions.

State Planning 

Has the state or system established essential AI policies and action steps that each postsecondary institution should incorporate into its AI policies?
Does the state or the system have a model policy for institutions to consider before they write their own?
Has the state or system office worked with accreditation agencies to clarify expectations for integrating AI?

Institution Planning

Does the institution have an overall strategic plan for AI integration?
If so, is every college and school required to follow the institution’s plan?
Or have individual colleges, schools or departments within the institution developed its own plan?
Has the institution’s faculty senate reviewed or endorsed the plan? 
What efforts is the institution making to involve students, faculty and the administration in policy discussions about AI integration?
How does AI fit into the institution’s long-term plan and goals?
Does the institution have any guidance in place governing the use of AI? 
Is the guidance customized for specific groups on campus such as students and faculty?
Has the institution published acceptable-use policies for students, faculty and staff?
Does the institution have any guidelines for the ethical use of AI, particularly concerning data privacy and student assessment?
Does the institution have acceptable use policies in place for AI? Are these targeted toward specific groups such as students and faculty?
How are ethical concerns about AI use communicated and addressed within the institution?

Finance

Does the institution have a budget allocated for AI integration, including training, tools and infrastructure?
What funds will the institution use to support its AI efforts?
Is the institution pursuing any external funding sources such as grants or partnerships to support AI efforts?
How will the institution plan to sustain AI efforts over time?

Access for All Students

Does the institution have sufficient computing devices available for both students and staff?
Do the institution and its students have access to high-speed broadband?
Are there disparities in access to technology among students? For example, do rural and low-income areas have access??
What programs does the institution have in place to ensure access to AI learning tools for all students?
Is the institution considering using AI tools to support students with special needs?
How is the institution using AI to address the diverse learning needs of its students?
Does the institution have pathways for students to engage in AI-related coursework or extracurricular activities?
Has the institution developed or adopted AI-related curricula? 

Privacy and Security

Does the institution have a data management system that can support AI?
Does the institution have clear data privacy policies in place?
Does the institution have a history of cybersecurity breaches? If so, what measures have been taken to address them?
Is the institution aware of state and federal privacy laws regarding AI use in education? 
How is the institution ensuring compliance with these laws?
Does the institution have AI data security protocol in place for dual enrollment students?
Is the institution considering a closed generative AI environment such as the University of Michigan? 

Professional Development and Support

What percentage of teaching staff have received training in AI tools and technologies?
Does the institution have access to AI specialists or consultants?
Are professional development opportunities in AI available to teaching assistants, faculty and administrators?
Does the institution have a technology team that can support the integration and maintenance of AI tools?
Does the institution have AI coaches or technology integration specialists?

Evaluation and Monitoring

How will the institution assess the effectiveness of AI tools and initiatives?
Has the institution built any feedback loops to ascertain how students or faculty are feeling about AI use on campus? If so, how is the being used?
What metrics will the institution use to evaluate AI’s impact on student outcomes?
How will the institution use metrics to improve teaching and learning?
How will the state or system office monitor each institution’s AI efforts and needs?

Sample State Support Actions

Steps for States to Support Institutions Based on Needs Assessment

State or system office recommends the next steps for the institution to address urgent gaps.

  • State or system office helps the institution develop a plan to train faculty, staff and students to build AI knowledge and capability.
  • State or system office helps the institution determine investments needed for technology and data management systems.
  • State or system office helps the institution revise its data security plan.
  • State or system office helps the institution create or revise acceptable-use policies to support ethical AI integration.
  • State or system office helps the institution develop or revise its long-term plan for sustainable AI integration into education.
  • State or system office assigns an AI faculty coach or trainer to the institution to help faculty integrate AI into their teaching practices.