United States

Assessment results provide valuable information about student learning. Accurately interpreting this information to modify courses is an essential step towards facilitating better student learning. Thus, as part of developing a standardized assessment for upper-division thermal physics, we design theory-based feedback for instructors in which they can trace how well their courses align with learning goals associated with scientific practices. This feedback provides instructors a ctionable information to operationalize scientific practices into their learning goals, thus encouraging not just content knowledge, but how to use that knowledge. In this talk, we lay out this feedback design process with specific examples from our data. This work highlights the importance of actionable feedback for instructors that facilitates explicit course modifications in physics classrooms. &amp;nbsp; &amp;nbsp; &amp;nbsp;

AAPT WM 21

Designing Research-based Assessment Feedback for Instructors

upper-division

assessment

feedback

AAPT® is a strong professional physics science society dedicated to the pursuit of excellence in physical science education.

Winter and Summer National Meetings:
These National Meetings, held each winter and summer, are opportunities for members, colleagues, and future physicists from around the world to:

- participate in physics workshops
- meet and greet other physics educators
- form networks nationally and locally
- engage exhibitors and learn about the latest physics resources
- discuss innovations in teaching methods
- share the results of research about teaching and learning.

If you're not able to log in, you're most likely using **incorrect login credentials**. Double-check that you are using the same email and password that you used to register for the conference, submit your abstract or access your AAPT membership. There may also be **an issue with your AAPT meeting registration**. Please email aapt2021@underline.io and programs@aapt.org and we will work quickly to resolve this issue.

Assessment results provide valuable information about student learning. Accurately interpreting this information to modify courses is an essential step towards facilitating better student learning. Thus, as part of developing a standardized assessment for upper-division thermal physics, we design theory-based feedback for instructors in which they can trace how well their courses align with learning goals associated with scientific practices. This feedback provides instructors a ctionable information to operationalize scientific practices into their learning goals, thus encouraging not just content knowledge, but how to use that knowledge. In this talk, we lay out this feedback design process with specific examples from our data. This work highlights the importance of actionable feedback for instructors that facilitates explicit course modifications in physics classrooms. &nbsp; &nbsp; &nbsp;

technical paper

We report on the development of a rubric designed to analyze pedagogical content knowledge in the context of questioning (PCK-Q). The rubric is based on five components of PCK-Q: Orientation, Knowledge of Curriculum, Knowledge of Students’ Understanding, Knowledge of Instructional Strategies and Knowledge of Assessment (Magnusson, 1999). We are developing it to analyze 1) written responses to an instrument designed to measure PCK-Q and 2) video classroom observations of student assistants’ (SAs’) interactions with students. The classroom observations have first been coded by a coding scheme that analyzes levels of questioning and direct instruction in an inquiry-based classroom. We expect the strongest evidence of PCK-Q in video sequences of SAs using sequences of guided questions. Guided questions demonstrate evidence of instructor content knowledge, knowledge of students’ understanding and knowledge of common student difficulties, while helping students evaluate experimental evidence, solve a problem or come to a correct conceptual understanding.&nbsp;

Development of a Rubric to Analyze Student Teaching Assistants’ PCK-Q

This will be a humbling talk. We take you on our journey of fails in digital and analouge data collection, encoding and scoring as well as procedures and ideas of fixing them. We answer questions like: “ How can I reach sufficient encoding redundancy? ”, “ How to estimate the coding error probability? ”, “ What are the pitfalls in (digital) data scoring? ”, “ What metadata might become useful for my analysis? ” Or as Springuel, Wittmann &amp; Thompson (2019, p.2) would say: “[D]ata encoding is often neglected or taken for granted, even though this step forms an important bridge between the data collection and analysis. ”

Fails for Concept Inventory (digital) Data Encoding

Our course "The Science of Acoustics" is an introductory course on waves, oscillations, and sound. My colleagues and I&nbsp;have been teaching the lab portion in a consistent way over the past decade with only minor tweaks to equipment and instructions, but our switch to remote learning forced me to rethink some activities. This talk is about making choices concerning how to modify&nbsp;lab activities so students can achieve the relevant learning objectives. I may not have made "correct" choices in every case, but I will discuss thinking on labs that range from ones&nbsp;kept basically identical except for the use of virtual equipment (e.g., a pendulum lab)&nbsp;to others where the questions we asked were completely flipped around (e.g., a lab on standing waves). I will also reflect on how this experience will affect my delivery when things go "back to normal."

Making choices for virtual labs in "The Science of Acoustics"

The use of custom, inexpensive home experiment kits during the pandemic revealed several strategies that will be applied to traditional teaching of introductory physics labs at Oglethorpe University.&nbsp; These include: using the&nbsp;PHYPHOX app and smartphone sensors;&nbsp;cost-effectively increasing&nbsp;the number of onsite lab stations using kit parts so more students are directly involved in running the experiments;&nbsp;having each student collect their own data and write up results with them while still collaborating with team members;&nbsp;limiting the number of formal lab reports required after students demonstrate documentation skills in order to focus on spreadsheet development&nbsp;and conceptual knowledge;&nbsp;and having home kits available even when onsite so students can use them remotely for custom projects based on standard experiments.&nbsp; In particular, having all students collect and analyze their own data virtually eliminates the 'freeloader' syndrome where some students do far less work than others on experiments and documentation.

Lessons from Home Experiment Kits for Traditional Introductory Physics Labs

We want to ask students to see patterns in time-series graphs of voltage. Traditionally, we put bulky, expensive oscilloscopes on the benches or made everyone share, or didn't even have one for our classroom. Now, we're teaching circuits with Tinkercad, or we're having students do self-directed projects with Arduinos, both with on-screen graphs of voltage over time. This is helping me teach reading time-series graphs to pre-high-school&nbsp;students;&nbsp;and logical approaches to patterns, and measuring time, to college&nbsp;students. We'll look at videos of oscilliscopes, simulated oscilloscopes, and similar tools.

Look Under Your Chair, Because You're All Getting Oscilloscopes!

The EQuIPD grant is a Department of Education Funded teacher professional development program centered on use of core content models, modeling instructionall practices and use of technology for collaborative inquiry experiences for students. As districts pivoted to new learning environments owing to COVID, teachers were placed in either hybrid, FTF or virtual classrooms.&nbsp; The grant has worked to support teachers in new forms of collaborative inquiry in several ways including sending kits home to students, teacher demonstrations/students analyzing data sets, virutal experiments and using cell phone apps (Arduino Science Journal, phyphox and Physics Toolkit. This talk will highlight the support for teachers to implement these new modes of inquiry and showcase some example lessons where students used cell phone apps to collect and analyze data in collaborative teams through an inquiry proccess to develop a core concept model in physical science. This model is appropriate for students at any level.

Working Together Alone: Colloborative Inquiry using Cell Phone Apps

Our algebra-based introductory physics class for life science students is entirely remote this year. The course is typically taught as a highly interactive multi-section studio class. It was a challenging transition but, by making extensive use of Zoom breakout rooms, we think we have done this fairly successfully. The transition has been a tremendous amount of work. The things we plan to retain when we eventually go back to in-person teaching include: (1) using interactive Google doc worksheets, rather than a printed workbook ; (2) spending less time presenting slides and more time with students working together; (3) regular low-stakes quizzes instead of a few high-stakes tests; and (4) streamlining the course, with fewer topics and not as many moving parts. This talk will go over details of these features, which seem to have worked well and which we hope will make for a better student experience in future semesters.

Keepers: From remote studio physics back to in-person

The STEMcoding project launched in 2017 with a series of "physics of video games" activities designed for high school physics and physical science. Many of these activities are described on the STEMcoding YouTube channel (http://youtube.com/c/STEMcoding) and we have trained dozens of teachers through various workshops. In 2020 these resources became a lifeline for many of these teachers who needed to find solutions for distance and hybrid learning. And over summer 2020 we redesigned nearly all of our activities with this in mind. This talk provides and overview of how 2020 has shaped the STEMcoding project.

The STEMcoding Approach to Distance Learning

The pandemic timeline has turn out to be much longer than initially predicted, and the need for a remote teaching will be the norm for many more months (if not years) to come. &nbsp;The immediate switch to the remote teaching that happened due to COVID-19, not surprisingly, had the greatest detrimental effect on laboratory components of physics courses and challenged academic integrity during testing. Smaller courses during summer time allowed us to test different approaches and more adequately prepare for large-enrollment classes for the upcoming Fall semester. Decisions when to choose between the labs with real data or simulations-generated data will be discussed. I will touch upon the challenges and successes of running the live lab sessions on teleconferencing platforms such as Zoom. Some elements, like pre-recorded introductions to the labs, methods of lab reports collections and grading online will be useful well past the pandemic.

Lessons from Virtual Laboratories

Material properties such as pressure, tension, conductivity and elasticity arise due to the complex interactions of atoms and electrons.&nbsp; Interaction forces such as friction also have atomistic origins.&nbsp; Our textbooks may mention these ideas in advanced topic boxes, but what do you say when a student wants to know more?&nbsp; In this talk, I will give a brief overview of the field of condensed matter physics.&nbsp; I will describe how condensed matter physics is present not only in our physics curriculum, but in daily life in technologies such as semiconductors, fiber optics, light-emitting diodes (LED’s), and liquid crystals.&nbsp; The talk is intended for anyone who teaches introductory physics, from college physics to secondary science teachers -- both high school and middle school.

Premium content

Designing Research-based Assessment Feedback for Instructors

Downloads

Next from AAPT WM 21

Development of a Rubric to Analyze Student Teaching Assistants’ PCK-Q

Similar lecture

Initial Implementation of an Upper-Division Thermal Physics Assessment