United States

Students scores on assessments play a vital role in course modifications, though their effectiveness relies on the quality of the interpretation of these scores. We adapt the notion of assessments as a change agent so that a well-developed rubric accompanied by intentionally designed instructor feedback can act as a tool to inform course improvement. In conjunction with work developing a standardized upper-division thermal physics assessment, this pilot work articulates a methodology to determine feedback for instructors to inform how well their courses support students in meeting learning goals. In this paper, we present an example using a task targeting the scientific practice of using mathematics to explicate this methodology. This work highlights the importance of assessment feedback to inform explicit course modifications in physics.

PERC SM 20

Assessment feedback: A tool to promote scientific practices in upper-division

scientific practices

assessments

upper-division

The 2020 AAPT Virtual Summer Meeting brought together physics educators from around the globe to learn about the latest in physics theory, research methodology and education from leaders in their field. The program featured plenary speakers, sessions, workshops and many special activities.

For more information please visit the 2020 AAPT Virtual Summer Meeting page at: https://www.aapt.org/Conferences/SM2020/index.cfm.


AAPT SM 20

The 2020 AAPT Virtual Summer Meeting brought together physics educators from around the globe to learn about the latest in physics theory, research methodology and education from leaders in their field. 

poster

Join us in exploring emergent themes in PER as a scholarly endeavor and as a research community!  Since its inception, PER has served as a confluence of discipline, theory, research methodology, practice, and application.  How have these facets and the interplays among them been fruitful for physics education globally, regionally, locally, or otherwise?  And, how have our successes and interactions influenced the very nature of PER itself?
Following the lead of AAPT for the summer meeting, PERC 20/20 was virtual. Enjoy browsing the content.

Since its inception, PER has served as a confluence of discipline, theory, research methodology, practice, and application.  How have these facets and the interplays among them been fruitful for physics education globally, regionally, locally, or otherwise?  And, how have our successes and interactions influenced the very nature of PER itself?

Student beliefs and faculty beliefs about study strategies are not always aligned. Using the Effective Study Strategies Survey, student beliefs about study strategies were surveyed for three semesters at a two-year college which is also a Hispanic Serving Institution. Then faculty were asked to predict how students answered on average to a subset of the questions on the student survey. The comparison between faculty predictions and student responses is discussed. Asking the faculty in a department to predict how their students responded to a survey is a useful way of determining where alignment between faculty and student belief already exists and where it needs improvement.

Comparison of student-reported study habits with faculty expectations and predictions

We present a set of modes of reasoning about ratio and proportion as a means of operationalizing expert practice in physics. These modes, or natures of proportional reasoning, stem from consideration of how physicists reason in context and are informed by prior work in physics and mathematics education. We frame the natures as the core of an emerging framework for proportional reasoning in introductory physics, that will categorize the uses of proportional reasoning in introductory physics contexts, and provide guidance for the development of reliable assessments. We share results from preliminary assessment items indicating that university physics students have difficulty interpreting and applying ratios in context.

Toward a Framework for the Natures of Proportional Reasoning in Introductory Physics

Learning Assistant (LA) programs support instructors transforming their courses to use evidence-based instructional strategies. We investigated the types of institutions that have LA programs to better understand how the distribution of those programs supports education across institutions. Using public websites and databases, we compared schools with and without LA programs, looking at a variety of institutional characteristics to determine whether the distribution of LA programs is equitable across different types of institutions. The results indicated that the majority of LA programs were at large-enrollment, public, research-intensive, four-year institutions. Minority serving institutions (MSIs) were equally well represented in the institutions with LA programs. MSIs with LA programs were, however, more likely than non-MSIs with LA programs to be teaching-intensive or two-year colleges. Further expanding the LA model into teaching-intensive and two-year colleges will more equitably share the benefits of the LA model with students from minoritized groups.

Characteristics of institutions with Learning Assistant programs: An equity investigation (PERC)

[This abstract represents one part of a two-part study; some language is reproduced in another abstract.] Our team is studying student ownership of projects, a significant learning outcome in many project-based lab courses. An empirical model of ownership will support educators and researchers in the practice, design, and implementation of courses that encourage student ownership. Our preliminary model was based on analysis of a subset of survey and interview data from five Western and Midwestern physics departments. In this talk, I will demonstrate how this ownership model maps onto our full dataset, including stimulated recall interviews, and what educational implications emerge from further analysis. In our model, ownership is more than an outcome that develops over time and is achieved by the projects end. Students may or may not experience ownership in any of three phases: choice of topic, execution of methods, and synthesis of results into reports or presentations.

Student Ownership of Lab Projects: Project Phases

We are developing a new research based assessment (RBA) focused on quantitative reasoning--rather than conceptual understanding--in physics contexts. We rapidly moved administration of the RBA online in Spring 2020 due to the COVID-19 pandemic. We present our experiences with online, unproctored administration of an RBA in development to students enrolled in a large-enrollment, calculus-based, introductory physics course. We describe our attempts to adhere to best practices on a limited time frame, and present a preliminary analysis of the results, comparing results from the online administration to earlier results from in-person, proctored administration. We include discussion of online administration of multiple-choice/multiple-response (MCMR) items, which we use on the instrument as a way to probe multiple facets of student reasoning. Our initial comparison indicates little difference between online and paper administrations of the RBA, consistent with previous work by other researchers.

Online administration of a reasoning inventory in development

Students sense of belonging in science has been identified as a predictor for students motivation, self-efficacy, and persistence in the field, especially for historically underrepresented students. Previous studies have shown that students sense of belonging can be influenced by interpersonal relationships (with peers, the instructor, or the general environment), perceived competence, course content, and other factors. We have administered attitudinal surveys to STEM students taking introductory physics labs at a large, diverse, Hispanic-serving public university, from Fall 2018 to Spring 2020. Courses surveyed include: a two-semester algebra-based sequence targeted toward students in the biosciences, a three-semester calculus-based sequence targeted toward engineering, computer science and physical science majors, and a one semester conceptual physics course targeted toward kinesiology majors. By identifying factors that affect students sense of belonging in the lab, we hope to further inform how we as a physics community can create inclusive, supportive scientific environments.

Students' Sense of Belonging in Physics Labs

In class discussions about the under-representation of women have been found to increase women's interest in physics-related careers and their physics identities. Using a figured worlds framework enhanced by an argumentation framework, we analyzed video of two under-representation discussions that occurred in a high school physics classroom to understand how the increase in interest in physics related careers and physics identities might be happening. We found that in the beginning of the discussion, students focus on an individual's choices or the influence of socialization, which contribute to them joining physics or not. Toward the end of the lesson students focus on the culture of physics which produce and reproduce under-representation and tie this framing of physics to experiences of their family members overcoming similar barriers in other fields. Future work could include student interviews or analyze more classroom artifacts to deepen our understanding of students' figured worlds and include perspectives of students who did not speak up in class.

Analyzing discussions of under-representation in a high school classroom

Most research focusing on student ideas about electric current frames these ideas as misconceptions, difficulties, and misunderstandings. This paper reports student resources for understanding electric current: ideas that we consider to be the beginnings of a scientific understanding. Here, we present three conceptual resources for understanding electric current based on our analysis of 550 written responses to conceptual circuits questions from introductory-level university physics students. Our aim is to offer knowledge that can support physics instructors in identifying and building on these resources during instruction.

Identifying student conceptual resources for understanding electric current

Learning Assistants (LAs) are undergraduate STEM students who participate in a pedagogy course and facilitate active learning among their peers in a variety of courses. Much of the existing research on LA programs focuses on the impact on the students taking courses with LAs, or on course transformation. In addition to this, we look at the impact on the LAs themselves, as students. We asked LAs in physics, other sciences, and math to reflect on how their LA experience has affected them, through interviews with fellow LAs and free-response surveys. We analyze these qualitative data to identify emerging themes. LAs found that their LA experiences had impacts on their conceptual understanding, metacognition, time management, confidence about public speaking and working with fellow students, and relationships with professors.

How the Learning Assistant Experience Impacts Learning Assistants as Students

The first two semesters of introductory calculus-based physics at Anonymous University are taught in two parallel formats: a flipped section (taught in a SCALE-UP-style active learning classroom, replacing lecture and recitation) and a traditional lecture section. To assess the influence on these formats on student performance and retention, we analyzed a data set of over 1000 students who took the traditional and/or flipped introductory courses in 2013-15, and tracked them longitudinally through their subsequent physics and engineering courses. Comparing grades in select later courses, initial results suggest that students who successfully completed the flipped version of Physics I received higher grades, while taking flipped Physics II is associated with lower grades. However, the full picture is more complicated. A greater fraction of the students who take flipped Physics II go on to take advanced courses, which suggests that this course with more active learning is associated with higher overall retention in physics and related fields.

Premium content

Assessment feedback: A tool to promote scientific practices in upper-division

Next from PERC SM 20

Comparison of student-reported study habits with faculty expectations and predictions

Similar lecture

Assessment feedback: A tool to promote scientific practices in upper-division