How Do You Get There From Here

  • Published on

  • View

  • Download


Overcoming Barriers in Implementing a Quality Assurance Process WCET 21st Annual Conference Deb Adair, Quality Matters Evelyn Everett Knowles, Park University Li Wang, University of Northern Colorado Heidi Ashbaugh, Texas Womans University


<ul><li> 1. How do you get there from here? <ul><li>Overcoming Barriers in Implementing a Quality Assurance Process </li></ul><ul><li>WCET 21 st Annual Conference </li></ul><ul><li>Deb Adair, Quality Matters </li></ul><ul><li>Evelyn Everett Knowles, Park University </li></ul><ul><li>Li Wang, University of Northern Colorado </li></ul><ul><li>Heidi Ashbaugh , Texas Womans University </li></ul>10/23/2009 Denver, Colorado </li> <li> 2. Presentation Agenda <ul><li><ul><li>QM Program Introduction </li></ul></li></ul><ul><li><ul><li><ul><li><ul><li>Deb Adair </li></ul></li></ul></li></ul></li></ul><ul><li><ul><li>Challenges/Solutions in Implementation: </li></ul></li></ul><ul><li><ul><li><ul><li>Course Development &amp; Review Process </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li><ul><li>Evelyn Knowles </li></ul></li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Faculty Development Training </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li><ul><li>Li Wang </li></ul></li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>A Multi-Year Plan for Implementation </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li><ul><li>Heidi Ashbaugh </li></ul></li></ul></li></ul></li></ul><ul><li><ul><li>Sharing Your Questions, Issues and Solutions </li></ul></li></ul></li> <li> 3. <ul><li>Deb Adair, Ph.D. </li></ul><ul><li>Director of Quality Matters </li></ul><ul><li>Adjunct Associate Professor, University of Maryland University College </li></ul>What is Quality Matters? </li> <li> 4. Quality Matters: Inter-Institutional Quality Assurance in Online Learning <ul><li>Quality Matters is a not-for-profit subscription service providing tools and training for quality assurance of online courses </li></ul><ul><li>Initially developed by MarylandOnline with funding from FIPSE, it was designed by faculty for faculty </li></ul><ul><li>Adopted by a large and broad user base, QM represents a shared understanding of quality in online course design </li></ul></li> <li> 5. Quality Matters is <ul><li>A set of standards (rubric) for the design of online and hybrid courses </li></ul><ul><li>A peer review process (faculty to faculty) for reviewing and improving online and hybrid courses </li></ul><ul><li>A faculty support tool used by instructional development staff </li></ul><ul><li>A professional development opportunity </li></ul></li> <li> 6. QM as a National Standard <ul><li><ul><li>370 + current subscribers </li></ul></li></ul><ul><li><ul><li><ul><li>( ) </li></ul></li></ul></li></ul><ul><li><ul><li>41 states represented </li></ul></li></ul><ul><li><ul><li>QM has trained 5000+ faculty and instructional design staff </li></ul></li></ul><ul><li><ul><li>Recognized by </li></ul></li></ul><ul><li><ul><li><ul><li>- Sloan C Excellence in Online Teaching and Learning Award </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>-2008 USDLA Outstanding Leadership in the field of Distance Learning </li></ul></li></ul></li></ul></li> <li> 7. Quality Matters Subscribers MONTANA WYOMING IDAHO WASHINGTON OREGON NEVADA UTAH CALIFORNIA ARIZONA NORTH DAKOTA SOUTH DAKOTA NEBRASKA COLORADO NEW MEXICO TEXAS OKLAHOMA KANSAS ARKANSAS LOUISIANA MISSOURI IOWA MINNESOTA WISCONSIN ILLINOIS INDIANA KENTUCKY TENNESSEE MISS ALABAMA GEORGIA FLORIDA SOUTH CAROLINA NORTH CAROLINA VIRGINIA WV OHIO MICHIGAN NEW YORK PENN MARYLAND DELAWARE NEW JERSEY CONN RI MASS MAINE VT NH ALASKA HAWAII Current Subscribers Statewide Subscribers PUERTO RICO VIRGIN ISLANDS </li> <li> 8. The QM Approach <ul><li>The QM toolset and process </li></ul><ul><li>A faculty-driven, peer review process that is </li></ul><ul><li><ul><li>C ollaborative </li></ul></li></ul><ul><li><ul><li>C ollegial </li></ul></li></ul><ul><li><ul><li>C ontinuous </li></ul></li></ul><ul><li><ul><li><ul><li>C entered - in academic foundation </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>- around student learning </li></ul></li></ul></li></ul></li> <li> 9. A shared goal: Quality online courses <ul><li>Improved courses </li></ul><ul><li>Engaged faculty </li></ul><ul><li>Reduced course development time </li></ul><ul><li>Ongoing faculty development </li></ul><ul><li>Quality benchmarking </li></ul><ul><li>Awareness &amp; support for online learning </li></ul><ul><li>Institutional improvement </li></ul>85 % </li> <li> 10. Getting there with QM can include <ul><li>A course development process leading to QM-recognized courses </li></ul><ul><li>Professional development (training) for faculty and staff </li></ul><ul><li>Institutional self-sufficiency in conducting official QM peer course reviews </li></ul></li> <li> 11. <ul><li>Evelyn Everett Knowles, Ph. D. </li></ul><ul><li>Coordinator of Program Quality Development </li></ul><ul><li>Park University </li></ul>Course Development Challenges </li> <li> 12. A Model for Enhancing Online Course Development : The Park University Continuous Quality Development Model </li> <li> 13. Continuous Quality Development Model Rapid Growth in Online Learning Culture of Assessment Platform Change / Content Manager Continuous Quality Development Model Collaboration between Faculty and Instructional Designer Quality Matters </li> <li> 14. Development Contract Course Developer Requirements Payment for Development New Online Course Development Initiate Course Development Maintenance Contract Course Maintenance Requirements Payment for Maintenance Online Course Development Policies Limits on the Timing and Number of Courses Developments per Developer Policies Directly Impacting Online Course Development Accessibility and ADA standards and requirements Academic Freedom Full-Time Faculty Contract Online Adjunct Faculty Contract Faculty Course Load Faculty Course Preparation Faculty Evaluation Student Academic Issues Online Attendance and Grades Proctoring for Online Programs Online Course Student Training Academic Policies Operational Policies Information Security Bookstore and Library Institutional Policies </li> <li> 15. Continuous Quality Development Model Literature Research Research Standards Best Practices Course Development Quality Matters Standards Online Course Development CD Requirements &amp; Checklist Quality Matters Rubric Park Online Quality Standards Review QSR University and CDL Policies Academic Department Requirements Park University Requirements Content Approval eCollege capabilities Best Practices </li> <li> 16. <ul><li>Common Course Structure : </li></ul><ul><li><ul><li>Where things are located </li></ul></li></ul><ul><li><ul><li>What content to develop </li></ul></li></ul><ul><li><ul><li>Accountability </li></ul></li></ul><ul><li>Checklist mapped to : </li></ul><ul><li><ul><li>Quality Matters standards </li></ul></li></ul><ul><li><ul><li>University requirements </li></ul></li></ul><ul><li><ul><li>Best Practices </li></ul></li></ul><ul><li><ul><li>OIES </li></ul></li></ul></li> <li> 17. Quality Review <ul><li>Quality Standards Review </li></ul><ul><li><ul><li>Quality Matters Rubric </li></ul></li></ul><ul><li><ul><li><ul><li> </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Report returned to Instructional Designer </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Recommendations and changes are made before the courses are duplicated for the next term </li></ul></li></ul></li></ul><ul><li><ul><li>Academic Department Review </li></ul></li></ul><ul><li><ul><li><ul><li>Required changes are made by the instructional designer with the Course Developer </li></ul></li></ul></li></ul></li> <li> 18. Recognized Courses <ul><li>2009 Quality Matters Recognized Courses </li></ul><ul><li>The following courses were recently recognized by Quality Matters in 2009. CourseTitleFaculty DeveloperInstructional Designer AC435Ethics for AccountantsJolene LamptonChris Slupianek BI210 The Human Body Carol Sanders Jim Whelan CJ332 Institutional, Industrial and Commercial Security Joe Angelo </li></ul><ul><li>Jackie Artmayer, David Curtis EN234Intro to FictionJane WoodJackie Artmayer FI363Financial Institutions and MarketsJoe KubecCasey Johnson GO205Intro to MeteorologyLeAnn AllisonChris SlupianekPS424Industrial and Organizational PsychologyWilliam NastJim Whelan </li></ul><ul><li>2008 Quality Matters Recognized Courses </li></ul><ul><li>The following courses were recently recognized by Quality Matters in 2008. CourseTitleFaculty DeveloperInstructional Designer CJ232Introduction to CorrectionsMichael Eskey CJ400 Constitutional Law in Criminal JusticeSamantha BurkeJackie Artmayer CJ430 Criminal Justice Research MethodsMike EskeyJim Whelan CS322Web Programming IIKathleen KalataEC300 Intermediate MicroeconomicsGuerman KornilovTeri Wright EC301Intermediate MacroeconomicsGuerman Kornilov Teri Wright EN201 Introduction to Literature Jane WoodJackie Artmayer EN221 Afro-American Literature Cynthia WilliamsJackie Artmayer EN306A Scientific and Technical Writing Dees StallingsEN306B Business Communications Dees StallingsEN306CProfessional Writing in the Disciplines Emily DonnelliHR434 Compensation Management Gina HellerKristy Sailors IS205 Managing Information Systems Frank UzinskyKathleen Kalata LG201 Systems Engineering and Analysis Ernest ReidJackie Artmayer LG415 Quality Control Scott SowderJackie Artmayer MG261 Business Law II Cathy TaylorDavid Curtis MG401 Senior Seminar in Business Paul FordKristy Sailors MG495 Business Policy Dennis HermerdingJim Whelan PS221Adolescent PsychologyTeresa MasonKristy Sailors PS361 Cross Cultural Psychology Dennis KerkmanJim Whelan PS410 Social Influence and Persuasion Jean MandernachJim Whelan SO208 Social Inequalities David CurtisSO210 Social Institutions Pat McGintyTeri Wright SO306Writing for Social SciencesJean MandernachJim Whelan </li></ul><ul><li>2007 Quality Matters Recognized Courses </li></ul><ul><li>The following courses were recognized by Quality Matters in 2007. </li></ul><ul><li>CourseTitleFaculty DeveloperInstructional Designer BI101Biological ConceptsCarol SandersJim Whelan CS321 Web Programming 1Katie KalataPS315 Theories of PersonalityJean MandernachSO141 Introduction to SociologyDavid Curtis </li></ul></li> <li> 19. <ul><li>Li Wang, Ph.D. </li></ul><ul><li>Instructional Designer </li></ul><ul><li>Center for the Enhancement of Teaching and Learning </li></ul><ul><li>University of Northern Colorado </li></ul>Faculty Training Challenges </li> <li> 20. Implementing Introducing Planning Goals CETL OES Future Ultimate faculty </li> <li> 21. <ul><li>Center for the Enhancement of Teaching &amp; Learning (CETL) </li></ul><ul><li><ul><li><ul><li>Models </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Conversations </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Funds </li></ul></li></ul></li></ul><ul><li>Office of Extended Studies (OES) </li></ul>Implementing Introducing Planning Goals </li> <li> 22. <ul><li>Needs Assessment (meetings in fall 2008) </li></ul><ul><li>Faculty Training (December 2008: onsite and three-day training) </li></ul><ul><li>QM project key staff training and training customization (ongoing) </li></ul><ul><li>Offering Workshops: group and one on one </li></ul>Implementing Introducing Planning Goals </li> <li> 23. Implementing Introducing Planning Goals CETL OES faculty Next : CETL </li> <li> 24. <ul><li>Implementing: CETL </li></ul><ul><li>Goals : 4 C Principles </li></ul><ul><li>Incentives : Travel award, training fees, &amp; recognition </li></ul><ul><li>Timeline : 1. Training (Spring 09) </li></ul><ul><li> 2. Self review (summer 09) </li></ul><ul><li> 3. Peer review (fall 09) </li></ul>Implementing CETL OES faculty Next : CETL Cont. </li> <li> 25. <ul><li>Implementing: CETL Cont. </li></ul><ul><li>Focus : Improve the quality of course design </li></ul><ul><li>Collaboration : Support, Share ideas across disciplines </li></ul><ul><li>Important Considerations : Time, Organization, collaboration </li></ul>Implementing CETL OES faculty Next : Faculty Back: CETL </li> <li> 26. Implementing CETL OES faculty Next : OES <ul><li>Cohort Spring 2009 </li></ul><ul><li>Non Cohort Summer 2009 </li></ul><ul><li>Individuals </li></ul>Comments: This workshop was highly beneficial in the following ways: encourages quality in online teaching, fosters faculty collaboration, gives support for faculty Back: CETL Cont. <ul><li>Spanish </li></ul><ul><li>Philosophy </li></ul><ul><li>Nursing </li></ul><ul><li>Criminal Justice </li></ul><ul><li>Special Education </li></ul><ul><li>Sociology </li></ul><ul><li>Library </li></ul><ul><li>Bilingual ESL </li></ul><ul><li>Educational Technology. </li></ul></li> <li> 27. <ul><li>OES: New Programs and Courses </li></ul><ul><li>Goals: Quality improvement, teaching, collaboration All new programs developed using QM </li></ul><ul><li>Incentives: RFP - $1000 to $2000 stipend for faculty developing new courses with QM </li></ul><ul><li>Progress: 3 new programs, 4 major revisions </li></ul><ul><li>2 sets professional development modules </li></ul><ul><li>1 program - QM Program Level Certification </li></ul><ul><li>New: MA Criminal Justice, MA Spec. Ed. Gifted/Talented, Interventionist Spec. Ed. Professional Development Series, ASL Interpreting Series </li></ul><ul><li>Revised: MS and Ph.D. in Nursing Ed, RN to BSN, Nursing Ed. Cert </li></ul>Implementing CETL OES faculty Next : Main Presentation Back: Faculty Cont. </li> <li> 28. Implementing Introducing Planning Goals Future Ultimate Next : Future </li> <li> 29. <ul><li>Future Goals </li></ul><ul><li>CETL: Cohort and Non Cohort </li></ul><ul><li><ul><li><ul><li>Conducting Peer Review </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Recruiting participants </li></ul></li></ul></li></ul><ul><li>OES: </li></ul><ul><li><ul><li><ul><li><ul><li><ul><li>Continuing use of RFP </li></ul></li></ul></li></ul></li></ul></li></ul><ul><li><ul><li><ul><li><ul><li><ul><li>Courses informally reviewed prior to delivery </li></ul></li></ul></li></ul></li></ul></li></ul><ul><li><ul><li><ul><li><ul><li><ul><li>One certified faculty in each participating program </li></ul></li></ul></li></ul></li></ul></li></ul><ul><li>Others: </li></ul><ul><li><ul><li><ul><li>Continuing collaboration between CETL &amp; OES </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Continuing support for QM related scholarship of teaching and learning </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Involving more faculty as non cohort (offering workshops) </li></ul></li></ul></li></ul><ul><li><ul><li><ul><li>Conducting research </li></ul></li></ul></li></ul>Goals Future Ultimate Next : Ultimate </li> <li> 30. Goals Future Ultimate <ul><li>Ultimate Goals </li></ul><ul><li>QM certified Representatives from each Program/department/college </li></ul><ul><li>Ongoing Official Course Reviews </li></ul><ul><li>Ongoing Official Program Reviews </li></ul><ul><li>Research dissemination </li></ul><ul><li>4 C Principles </li></ul>Back: Future End </li> <li> 31. <ul><li>Awareness </li></ul><ul><li>Time </li></ul><ul><li>Incentives </li></ul><ul><li>Retention </li></ul><ul><li>Collaboration </li></ul></li> <li>...</li></ul>