From GGCWiki
Jump to: navigation, search

Augmented Reality Experiences in Chemistry

The need for AR in the classroom

Isomer Triggers

Students have displayed varying areas of difficulty when learning the fundamentals of chemistry. One key problem is learning and understanding molecular structures. This could be attributed to a disconnect between written formulas and 2D examples, and being able to visualize a molecule's spatial structures from that information. Understanding and visualizing spatial structures is necessary for students to understand chemical reactions, molecule interactions, and even VSEPR theory. By use of AR, students bridge the gap between 2D or written representations, and 3D visualization. AR also engages the student in active learning to reinforce the concepts they are learning.

Instructions for Demo Configuration

Instructions for Demo Configuration and application use are provided here.

Prior Projects

ChemReality Demo

Visualizing Molecules Using Augmented Reality and Image Recognition

The AR and Image Recognition Project was conceived to help provide a 3D chemical representation of a 2D chemical structure. By aiming the camera of your device at the 2D chemical structure a 3D representation of that structure will appear on your device's display. The app is more portable than the commonly used chemistry model kits, and produces a 3D representation instantly rather than having to build the structure piece by piece. The app allows free movement of the 3D object and can load multiple 3D objects of various 2D structures at the same time. Being able to load multiple structures will help students better understand structures like stereo-isomers.

MR Mol: Mixed Reality Molecule

MR Mol is a Mixed Reality application that creates 3D chemical structures in which the user may interact with through gestures and voice commands. MR Mol allows the user to freely move around the molecule in three dimensions offering the same molecule from different perspectives. Through use of MR Mol, students may development a better understanding of a molecule's molecular geometry, the effect single, double, and triple bonds have on bond distance, and how to differentiate stereo-isomers.

ChemReality Demo

Molecules and Machine Learning: Image Classification for an AR-Enabled Chemistry Classroom

In coordination with augmented reality (AR), artificial intelligence (AI) and machine learning (ML) has the potential of creating a new way of interacting with the world, particularly in the field of education. Our research team trained and utilized an AI model that will help chemistry students understand molecular structures. Hand-drawn or computer-generated images are uploaded and ran through the model. They are then labeled and used to generate an interactive 3D model that students can use to study.


MR Mol: Mixed Reality Molecule

 MR Mol Project, Abridged (2 mins)
 Very Abridged Version (43 seconds)
 CCSC Conference Submission


 ARChem CCSC Poster 2018
 ARChem CCSC Abstract Paper 2018
 ARChem Demo Video

Molecules and Machine Learning

 CCSC Abstract Submission
 Image References

For More Information


  • Dr. Derek Behmke at
  • Dr. David Kerven at
  • Dr. Evelyn Brannock at
  • Dr. Robert Lutz at
Personal tools