Smarter Balanced Assessment Consortium: Next Generation Assessment.

  • Published on
    17-Dec-2015

  • View
    212

  • Download
    0

Transcript

  • Slide 1
  • Smarter Balanced Assessment Consortium: Next Generation Assessment
  • Slide 2
  • Whats Next? Overview of the Smarter Balanced Assessment Consortium Overview of the Smarter Balanced Assessment Consortium Significant Assessment Shifts Significant Assessment Shifts Types of Items Types of Items Cognitive Rigor Matrix Cognitive Rigor Matrix Deconstruction of a Performance Task Deconstruction of a Performance Task
  • Slide 3
  • A National Consortium of States 28 states representing 44% of K-12 students 28 states representing 44% of K-12 students 21 governing, 7 advisory states 21 governing, 7 advisory states Wisconsin is a governing state Wisconsin is a governing state
  • Slide 4
  • SBAC Balanced Assessment System Common Core State Standards specify K-12 expectations for college and career readiness Common Core State Standards specify K-12 expectations for college and career readiness All students leave high school college and career ready Teachers and schools have information and tools they need to improve teaching and learning Interim assessments Flexible, open, used for actionable feedback Summative assessments Benchmarked to college and career readiness Teacher resources for formative assessment practices to improve instruction
  • Slide 5
  • Using Computer Adaptive Technology for Summative and Interim Assessments Turnaround in weeks compared to months Faster results Fewer questions compared to fixed form tests Shorter test length Provides accurate measurements of student growth over time Increased precision Item difficulty based on student responses Tailored to student ability Larger item banks mean that not all students receive the same questions Greater security GMAT, GRE, COMPASS (ACT), Measures of Academic Progress (MAP) Mature technology
  • Slide 6
  • Significant Assessment Shifts Performance Tasks Performance Tasks Close Reading Close Reading Informational Text Informational Text Analytical Writing Analytical Writing Technology Enhanced Questions Technology Enhanced Questions
  • Slide 7
  • SBAC Evidence-Based Design Identify what students should know and be able to do to demonstrate readiness for college and career: Identify what students should know and be able to do to demonstrate readiness for college and career: Four Claims
  • Slide 8
  • Turn & Talk: Four Claims 1. Students can read closely and analytically to comprehend a range of increasingly complex literacy and informational texts 2. Students can produce effective and well-grounded writing for a range of purposes and audiences 3. Students can employ effective speaking and listening skills for a range of purposes and audiences 4. Students can engage in research/inquiry to investigate topics, and to analyze, integrate, and present information
  • Slide 9
  • SBAC Evidence-Based Design Identify the kinds of evidence that would be sufficient to support the claims. These evidence statements are: Identify the kinds of evidence that would be sufficient to support the claims. These evidence statements are: Assessment Targets Turn & Talk-What kinds Turn & Talk-What kinds of assessment do you of assessment do you typically use in your classroom? typically use in your classroom?
  • Slide 10
  • SBAC Item Types Selected Response Constructed Response Performance Tasks Technology Enhanced Complex Thinking Skills Analysis Analysis Synthesis Synthesis Critical Thinking Critical Thinking
  • Slide 11
  • SBAC Item Types Selected Response 1 Claim 1 Claim 1 Assessment Target 1 Assessment Target Multiple Choice-may have multiple Multiple Choice-may have multiple answers. 1-2 minutes per item Constructed Response 1 Claim 1 Claim 1 Assessment Target 1 Assessment Target Short or long responses scored according to a rubric Short or long responses scored according to a rubric 5-10 minutes per item 5-10 minutes per item
  • Slide 12
  • SBAC Item Types Performance Tasks Multiple Claims Multiple Claims Multiple Targets Multiple Targets
  • Slide 13
  • SBAC Cognitive Rigor Foundation What is cognitive rigor? What is cognitive rigor? Write down your definition Write down your definition Discuss with your table Discuss with your table
  • Slide 14
  • Your class has just read some version of Little Red Riding Hood. What is a basic comprehension question you might ask? What is a basic comprehension question you might ask? What is a more rigorous question you might ask? What is a more rigorous question you might ask? Now lets apply your rigor definition
  • Slide 15
  • Different states/schools/teachers use different models to describe cognitive rigor. Each addresses something different. Bloom What type of thinking (verbs) is needed to complete a task? Bloom What type of thinking (verbs) is needed to complete a task? Webb How deeply do you have to understand the content to successfully interact with it? How complex is the content? Webb How deeply do you have to understand the content to successfully interact with it? How complex is the content? Developing the Cognitive Rigor Matrix
  • Slide 16
  • KnowledgeDefine, duplicate, label, list, name, order, recognize, relate, recall RememberRetrieve knowledge from long-term memory, recognize, recall, locate, identify ComprehensionClassify, describe, discuss, explain, express, identify, indicate, locate recognize, report, review, select, translate UnderstandConstruct meaning, clarify, paraphrase, represent, translate, illustrate, give examples, classify, categorize, summarize, generalize, predict ApplicationApply, choose, demonstrate, dramatize, employ, illustrate, interpret, practice, write ApplyCarry out or use a procedure in a given situation; carry out or use/apply to an unfamiliar task AnalysisAnalyze, appraise, explain, calculate, categorize, compare, criticize discriminate, examine AnalyzeBreak into constituent parts, determine how parts relate SynthesisRearrange, assemble, collect, compose, create, design, develop, formulate, manage, write EvaluateMake judgments based on criteria, check, detect inconsistencies/fallacies, critique EvaluationAppraise, argue, assess, choose, compare, defend, estimate, explain, judge, predict, rate, core, select, support, value CreatePut elements together to form a coherent whole, reorganize elements into new patterns/structures Blooms Taxonomy [1956 ] & Blooms Cognitive Process Dimensions [2005]
  • Slide 17
  • Webbs Depth-of-Knowledge Levels Webb's DOK Webb's DOK
  • Slide 18
  • DOK-1 Recall & Reproduction - Recall of a fact, term, principle, concept, or perform a routine procedure DOK-1 Recall & Reproduction - Recall of a fact, term, principle, concept, or perform a routine procedure DOK-2 - Basic Application of Skills/Concepts - Use of information, conceptual knowledge, select appropriate procedures for a task, two or more steps with decision points along the way, routine problems, organize/display data, interpret/use simple graphs DOK-2 - Basic Application of Skills/Concepts - Use of information, conceptual knowledge, select appropriate procedures for a task, two or more steps with decision points along the way, routine problems, organize/display data, interpret/use simple graphs DOK-3 - Strategic Thinking - Requires reasoning, developing a plan or sequence of steps to approach problem; requires some decision making and justification; abstract, complex, or non- routine; often more than one possible answer DOK-3 - Strategic Thinking - Requires reasoning, developing a plan or sequence of steps to approach problem; requires some decision making and justification; abstract, complex, or non- routine; often more than one possible answer DOK-4 - Extended Thinking - An investigation or application to real world; requires time to research, problem solve, and process multiple conditions of the problem or task; non-routine manipulations, across disciplines/content areas/multiple sources DOK-4 - Extended Thinking - An investigation or application to real world; requires time to research, problem solve, and process multiple conditions of the problem or task; non-routine manipulations, across disciplines/content areas/multiple sources Webbs Depth-of-Knowledge Levels
  • Slide 19
  • Why Depth of Knowledge (DOK)? Mechanism to ensure that the intent of the standard and the level of student demonstration required by that standard matches the assessment items (required under NCLB) To ensure that teachers are teaching to a level that will promote student achievement
  • Slide 20
  • Same Verb Three Different DOK Levels DOK 1- Describe three characteristics of metamorphic rocks. (Requires simple recall) DOK 2- Describe the difference between metamorphic and igneous rocks. (Requires cognitive processing to determine the differences in the two rock types) DOK 3- Describe a model that you might use to represent the relationships that exist within the rock cycle. (Requires deep understanding of rock cycle and a determination of how best to represent it)
  • Slide 21
  • Slide 22
  • Turn and Talk Using the Cognitive Rigor Matrix, discuss your Little Red Riding Hood questions with your tablemates. Using the Cognitive Rigor Matrix, discuss your Little Red Riding Hood questions with your tablemates. What DOK level would you assign to each of your questions and why? What DOK level would you assign to each of your questions and why? How would you describe the differences between DOK 2 and DOK 3? How would you describe the differences between DOK 2 and DOK 3? How would you describe the differences between DOK 3 and DOK 4? How would you describe the differences between DOK 3 and DOK 4?
  • Slide 23
  • Depth + thinking Level 1 Recall & Reproduction Level 2 Skills & Concepts Level 3 Strategic Thinking/ Reasoning Level 4 Extended Thinking Remember -Recall facts Understand -Identify characters, setting, etc. -Retell or summarize Apply Analyze -Compare-contrast-Analyze multiple texts/sources & using text evidence for support Evaluate -Justify judgments using details/evidence from text Create -Develop a creative summary The CR Matrix: A Reading Example Back to Little Red Riding Hood
  • Slide 24
  • If there is only one correct answer, it is probably level DOK 1 or DOK 2 If there is only one correct answer, it is probably level DOK 1 or DOK 2 DOK 1: you either know it (can recall it, locate it, do it) or you dont DOK 1: you either know it (can recall it, locate it, do it) or you dont DOK 2 (conceptual): apply one concept, then make a decision before going on applying a second concept DOK 2 (conceptual): apply one concept, then make a decision before going on applying a second concept If more than one solution/approach, requiring evidence, it is DOK 3 or 4 If more than one solution/approach, requiring evidence, it is DOK 3 or 4 DOK 3: Must provide supporting evidence and reasoning (not just HOW solved, but WHY explain reasoning) DOK 3: Must provide supporting evidence and reasoning (not just HOW solved, but WHY explain reasoning) DOK 4: all of 3 + use of multiple sources or texts DOK 4: all of 3 + use of multiple sources or texts Some general rules of thumb
  • Slide 25
  • Assessing only at the highest DOK level will miss opportunities to know what students do & dont know go for a range; end high in selected/prioritized content Assessing only at the highest DOK level will miss opportunities to know what students do & dont know go for a range; end high in selected/prioritized content Performance assessments can offer varying levels of DOK embedded in a larger, more complex task Performance assessments can offer varying levels of DOK embedded in a larger, more complex task Planned formative assessment strategies and tools can focus on differing DOK levels Planned formative assessment strategies and tools can focus on differing DOK levels Take-Away Message: Cognitive Rigor & Some Implications for Assessment
  • Slide 26
  • Revisit your definition of rigor has it changed/been refined? In what way? Revisit your definition of rigor has it changed/been refined? In what way? What is one way you might apply these ideas in your work? What is one way you might apply these ideas in your work? What existing curriculum/assessment materials could you/your school examine for a range of cognitive rigor? What existing curriculum/assessment materials could you/your school examine for a range of cognitive rigor? Classroom/instructional practices? Classroom/instructional practices? Turn & Talk: Reflecting on your own learning
  • Slide 27
  • SBAC Sample Items http://sampleitems.smarterbalanced.org
  • Slide 28
  • SBAC Selected Response Example Read the sentence from the text. Then answer the question: Nanodiamonds are stardust, created when ancient stars exploded long ago, disgorging their remaining elements into space. Read the sentence from the text. Then answer the question: Nanodiamonds are stardust, created when ancient stars exploded long ago, disgorging their remaining elements into space. Based on the context of the sentence, what is the most precise meaning of disgorging? Based on the context of the sentence, what is the most precise meaning of disgorging? A. scattering randomly B. throwing out quickly C. spreading out widely D. casting forth violently
  • Slide 29
  • SBAC Constructed Response Example In the space below, identify the sentences from the paragraph that are unnecessary, and briefly explain why each one should be removed. In the space below, identify the sentences from the paragraph that are unnecessary, and briefly explain why each one should be removed.
  • Slide 30
  • SBAC Performance Tasks StimulusInformation ProcessingProduct/Performance Stimulus Information Processing Product/Performance readings video clips audio clips research topic/issue/problem graphs, charts, other visuals etc. research questions comprehension questions simulated internet search etc. essay, report, story, script oral presentation or speech with/without graphics, other media responses to embedded constructed-response questions etc. Structure of Performance Task
  • Slide 31
  • Performance Tasks Primary Claims to be Measured Primary Claims to be Measured Writing-narrative, research, possibly reading Writing-narrative, research, possibly reading Writing-informational/explanatory, research, possibly reading Writing-informational/explanatory, research, possibly reading Writing-argumentative, research, possibly reading Writing-argumentative, research, possibly reading Writing-opinions, research, possibly reading Writing-opinions, research, possibly reading Speaking, research, reading, listening Speaking, researc...

Recommended

View more >