United States

Professional development is an effective way to diffuse evidence-based instructional practices. At the same time, assessing the impacts of professional development opportunities in physics education is still an emerging field. In this paper, we examine the efficacy of an assessment instrument designed to evaluate a university-wide professional development program at NDSU, the Theory of Planned Behavior Survey (TPBS). The development of the TPBS is based on the Theory of Planned Behavior, a theoretical framework originated in psychology, which uses participants attitudes, norms, and perceived behavioral control beliefs about a particular behavior (e.g., implementation of active learning) to predict intentions and explain that behavior. The TPB has been used in other fields to understand and predict behaviors, but it has not been utilized in STEM Ed research. Previous work has identified a link between changes in the constructs measured by the instrument that occurred after professional development at NDSU and the increase in the participants’ use of active learning techniques in the classroom. In this paper, we focus on examining evidence for the validity of the instrument and discuss methodologies for data collection, namely the retrospective pre-test approach, which avoids biases associated with self-reported data collected via traditional pre-post survey administrations. We use Arjoon, Xu, and Lewis’s framework for validity and provide evidence for the reliability, internal structure, and temporal stability of our instrument. We will also compare results from our instrument to those obtained using the Approaches to Teaching Inventory.

PERC SM 21

Examining the efficacy of a professional development assessment tool

assessment techniques

instrument validation

professional development

**Making Physics More Inclusive and Eliminating Exclusionary Practices in Physics**

As a gateway discipline to STEM majors and careers, physics plays a central role in deciding who does, and who doesn't, get to discover and pursue scientific careers. Technical and scientific professionals are rewarded with economic privilege and status which affords them both social and cultural power. Therefore, social justice will be realized only when the opportunity, and the choice, to excel in physics is open to all students. The culture and practices of the physics classroom reflect the culture of physics at large, which raises the question of how our professional physics communities can embrace, rather than inadvertently repel, a diverse group of academics that can help improve physics culture.  To this end, the 2021 Physics Education Research Conference will focus on defining inclusive spaces and practices. Additionally, we will explore strategies for eliminating exclusionary practices in our classrooms, research spaces, and professional organizations. We call on the community to propose sessions that will drive conversations related to these initiatives throughout PERC 2021.

Please download the full program [here. ](https://drive.google.com/file/d/1TRMC_SYJ3PUqXyP7sskA7LRSA8ow0eRE/view?usp=sharing)

August 4, 2021 - August 5, 2021 in a Virtual Conference Format

Making Physics More Inclusive and Eliminating Exclusionary Practices in Physics

poster

“The Hobby-Eberly Dark Energy Experiment (HETDEX) will find over one million galaxies that are 9 billion to 11 billion light-years away, and will yield the largest map of the universe ever produced. Over the past year, I have used Zooniverse, the worlds largest citizen science platform, to train participants all over the world to efficiently classify these galaxies. The map will allow us to measure how fast the universe was expanding at different times in its history. Changes in the expansion rate will reveal the role of dark energy at different epochs, but the most difficult task is determining which galaxies come from our epoch of interest (at z~2-3) and which ones are nearby. These one million sources require visual classification for the most accurate results, an amount not feasible to handle from within the collaboration. The project, Dark Energy Explorers, has been live for 3 months and we have already had over 1.5 million classifications. I will discuss the methods we have used and how citizen science can be applied to big data astronomy and how we have preliminarily applied machine learning."

Power of the people: Using citizen science to power big data astronomy

Learning Assistants (LAs) are increasingly used in classrooms all over the globe, where LAs help teach in a variety of student-centered, active-learning environments. The LA Model consists of three core components: the LA pedagogy course, weekly preparatory meetings with the instructional team, and the actual LA teaching practice of working with small groups of students. In this paper we utilize an existing framework of essential pedagogy principles identified by Top \textit{et al}.\ to develop a methodology for comparing what LAs learn in the pedagogy course to what they do in their LA practice. We apply the methodology to audio recordings of ten different LAs facilitating student discussion in five separate sections of an approximately 400 person, introductory studio physics course. We compare the degree to which LAs incorporate key concepts from the pedagogy class and propose ways to utilize our methodology to enhance the implementation of the LA Model.

Pedagogy in practice: exploring the use of pedagogy course knowledge by learning assistants

Learning Assistants are undergraduate peer educators that help facilitate learning in a university classroom environment. According to Jardine (2019), Learning Assistant feedback to faculty roughly falls into three categories: course logistics, student behavior, and student understanding. Her work also defined the roles that Learning Assistants assume: students, informants, consultants, co-instructors, or co-creators. We built from this previous work by characterizing the feedback given to faculty by Learning Assistants and found connections between Learning Assistant roles and the feedback. Using video from interviews with Learning Assistants and faculty working with Learning Assistants, we created a two-dimensional preliminary framework for the feedback and roles assumed by Learning Assistants in order to explore the relationship between the two.

Developing a framework to characterize the feedback that Learning Assistants give to faculty

Understanding how experienced and novice teachers learn in the context of professional development can help us develop a supportive community of practice. However, the nature of teachers’ learning conceptualized as meaning making processes using in-depth data analysis and robust theoretical frameworks is still understudied. In this study, the learning processes of two high school physics teachers— one expert and one novice—were reviewed as they participated in the Illinois Physics and Secondary Schools (IPaSS) partnership program in summer 2020. Positioning theory was used as a lens to unpack teachers’ discussion on conceptual reasoning about energy in paired collaborative work. The analysis was validated and augmented by individual video-stimulated recall interviews, during which each teacher shared her perspective on the interactions that took place during the collaborative work. Preliminary results revealed two main storylines from the interactions of these two teachers: 1) the experienced teacher’s self-positioning as a learner, and 2) the novice teacher’s openness to learn, which established rapport and created a space where both felt comfortable sharing their ideas and expressing uncertainty, enabling them to collaborate productively and support each other’s professional development.

Expert-Novice Teacher Interactions in a Professional Development Partnership Program

San Francisco State University (SFSU), a large Hispanic-serving institution, launched a Learning Assistant (LA) program in Spring 2017, including introductory physics, astronomy, and chemistry courses, with plans to expand to math and computer science. Like many LA programs, we aim to transform large, traditionally lecture-based introductory STEM courses to a more active and inclusive learning environment through the addition of undergraduate facilitators working in concert with course instructors. At SFSU, LAs receive upper-division elective credits to participate in a weekly pedagogy course with targeted readings, discussions, and reflection essays on teaching practices, plus a weekly prep session with their mentor (the course instructor), where they discuss specific activities to be implemented in the classroom. Several studies have shown content and affective gains for students in courses with LAs and for LAs. As our LA program has grown to include more courses, instructors, and LAs, we have been collecting interviews with LAs and faculty as well as reflection essays from the pedagogy course to gain insight regarding implementation challenges and benefits, dynamics between faculty, LAs, and students, and the general experience of the LAs and their faculty mentors. We have iteratively coded responses to interview questions and essays and tallied frequency counts of emergent themes. These results will give insight into the effects of the LA program being implemented for the first time at San Francisco State University. Results will inform the continuation and expansion of the LA program in the College of Science and Engineering.

Exploring Experiences, Benefits, Challenges, and Dynamics in a Developing Learning Assistant Program

The Learning Assistant (LA) program is designed to encourage the transformation of courses to incorporate more evidence-based pedagogical practices. The LA pedagogy course is one of the three central components of the program and diversely implemented across institutions with LA programs. The purpose of this study is to identify and compare the choices made by instructors regarding the composition of the LA pedagogy course at two different institutions -- one being a small, historically-women’s, liberal-arts college and the other a large research university. To gather data, interviews were conducted with the LA pedagogy course instructor at each institution. These interviews show that instructors adapt the LA pedagogy course to their institutions in different ways, and that fostering relationship-building is an important factor for instructors as they decide how to design and teach their local pedagogy course. In describing the varied ways in which instructors implement the LA pedagogy course and the motivations behind those choices, this study could help guide different institutions when implementing their own pedagogy course.

An investigation of how instructors choose to implement the Learning Assistant (LA) pedagogy course and their motivations

Magnetism is a significant topic in physics and student reasoning about magnetism is of interest to PER. Temporary magnetism is encountered during scientific inquiry, and pervasive in school physics, despite it typically not being an explicit part of the curriculum. We examine how middle grade students reason with this complex topic, and findings demonstrate that students' reasoning about different facets of this topic reflect that complexity.

Middle grade students reasoning about temporary magnetism

In recent years, multiple reforms have been suggested in the instructional physics lab to leverage students' agency in a range of experimental practices. Granting students’ agency over experimental design is a particularly persistent challenge, due to powerful structural features such as verifying that the apparatus is "operator proof" and that the students can obtain the expected measurements in a limited amount of time. As a result, labs often include pre-prepared lab "kits" and detailed step-by-step instructions, thus effectively undermining students’ engagement in experimental design. 

We examined teachers’ awareness of design considerations in the context of an activity problematizing the role of multimeters when measuring the relationship between the current through a battery and its terminal voltage. The activity took place in a national network of Professional Learning Communities (PLCs) for high-school physics teachers (11 nationwide year-long regional PLCs; N ? 300 physics teachers, a broad spectrum of socioeconomic backgrounds, representing about a quarter of the national workforce, operating in the high-stakes context of a national matriculation exam). The dataset was composed of 100 individual responses to a questionnaire administered at the beginning of the activity. Later stages consisted of small group and plenum discussions, as well as reflections at the end of the activity. 

The findings indicate that at the beginning of the activity, most of the teachers were not able to articulate many key design considerations, such as how choices related to the location of the multimeters and the measurement scale impacted the precision and range of measurements and the control of variables. 

The teachers were highly engaged in the follow-up components of the activity and enthusiastic about its contribution to raising awareness of considerations in experimental design.

Teachers' awareness of aspects of experimental design: the case of multimeters

To develop students’ critical reflection it’s necessary to implement in traditional course structure some activities promoting metacognitive control for self-regulated learning. Referring to some recent works on physics education research (Warren, 2018 and 2020) which showed the great potential of using Bayesian updating activities in introductory algebra and calculus based physics courses, we tried to use the same strategies for the curricular study of wave phenomena in two different classes of an Italian high school for scientific studies. In fact, we believe that as soon as it is possible to engage students in the use of hypothetico-deductive reasoning, better we could promote an authentic practice of physics, even in its early stage of study. To evaluate the effectiveness of those methods we compared pre and post test student scores on the Epistemological Beliefs Assessment for Physical Science (EBAPS), obtaining a meaningful gains in particular in the axis of "Nature of knowing and learning" and in the one of "Evolving knowledge" that is what we expected in developing epistemological beliefs as a consequence of metacognitive self consciousness.

Monitoring the wave phenomena learning process through Bayesian updating activities

There are many difficulties for students when it comes to learning the fundamental relationships in Newtonian mechanics, which is supported by manifold research. Even after class the understanding of Newton’s laws of motion is often inadequate, which is problematic because classical mechanics is the foundation of many other areas in physics and the natural sciences in general. These problems stem from the fact that students’ preconceptions in the field of mechanics are especially diverse and persistent because they are strengthened in everyday life over the course of many years. These preconceptions and the fact that idealized situations are often most prominent in class can lead to a felt incompatibility of everyday life and physics lessons. The computer can be a tool to reduce that gap by discussing complex and authentic motions in class without the need to use difficult math, which can lead to reduction in certain unwanted preconceptions. Two different ways of using the computer in mechanics class, computational modeling and video motion analysis, are presented on the poster. The two methods are compared in a pre-post design study with N = 267 students from 11th grade from German high schools in regard to the overall conceptual understanding of Newton’s first two laws. The results suggest that both methods can be successful in teaching the basic concepts of Newtonian dynamics and no differences can be seen in the overall scores for conceptual understanding. Furthermore, it seems that computational modeling performs better in items regarding Newton’s first law, due to a comparatively greater reduction of a specific preconception, which is further explained on the poster.

Premium content

Examining the efficacy of a professional development assessment tool

Next from PERC SM 21

Power of the people: Using citizen science to power big data astronomy

Similar lecture

Development of Physics and Math Faculty during Online Professional Development Experience