Augmented Reality Experiences in Chemistry
The need for AR in the classroom
Students have displayed varying areas of difficulty when learning the fundamentals of chemistry. One key problem is learning and understanding molecular structures. This could be attributed to a disconnect between written formulas and 2D examples, and being able to visualize a molecule's spatial structures from that information. Understanding and visualizing spatial structures is necessary for students to understand chemical reactions, molecule interactions, and even VSEPR theory. By use of AR, students bridge the gap between 2D or written representations, and 3D visualization. AR also engages the student in active learning to reinforce the concepts they are learning.
Instructions for Demo Configuration
Instructions for Demo Configuration and application use are provided here.
Visualizing Molecules Using Augmented Reality and Image Recognition
The AR and Image Recognition Project was conceived to help provide a 3D chemical representation of a 2D chemical structure. By aiming the camera of your device at the 2D chemical structure a 3D representation of that structure will appear on your device's display. The app is more portable than the commonly used chemistry model kits, and produces a 3D representation instantly rather than having to build the structure piece by piece. The app allows free movement of the 3D object and can load multiple 3D objects of various 2D structures at the same time. Being able to load multiple structures will help students better understand structures like stereo-isomers.
MR Mol: Mixed Reality Molecule
MR Mol is a Mixed Reality application that creates 3D chemical structures in which the user may interact with through gestures and voice commands. MR Mol allows the user to freely move around the molecule in three dimensions offering the same molecule from different perspectives. Through use of MR Mol, students may development a better understanding of a molecule's molecular geometry, the effect single, double, and triple bonds have on bond distance, and how to differentiate stereo-isomers.
- PowerPoint Presentation
- MR Mol Project (5 mins)
- Mr. Mol Demo
- MR Mol Demo (41 secs)
Molecules and Machine Learning: Image Classification for an AR-Enabled Chemistry Classroom
In coordination with augmented reality (AR), artificial intelligence (AI) and machine learning (ML) has the potential of creating a new way of interacting with the world, particularly in the field of education. Our research team trained and utilized an AI model that will help chemistry students understand molecular structures. Hand-drawn or computer-generated images are uploaded and ran through the model. They are then labeled and used to generate an interactive 3D model that students can use to study.
MR Mol: Mixed Reality Molecule
MR Mol Project, Abridged (2 mins) Very Abridged Version (43 seconds) CCSC Conference Submission
Molecules and Machine Learning
For More Information
- Dr. Derek Behmke at firstname.lastname@example.org
- Dr. David Kerven at email@example.com
- Dr. Evelyn Brannock at firstname.lastname@example.org
- Dr. Robert Lutz at email@example.com