Exploiting Extended Reality Technologies for Educational Microscopy

Part of the XRLabs Project
A low-cost and user-friendly multi-platform system for mobile devices which, coupled with edutainment dynamics, simulation, extended reality and natural hand movements sensing technologies such as hand gestures with virtual triggers, focus in the engagemen of users and prepare them efficiently for the actual on-site laboratory experiments.

Cite this work as: Theodoropoulou, G.H., Kiourt, C., Lalos, A., Koutsoudis, A., Paxinou, E. Kalles, D. and Pavlidis, G.(2020),Exploiting Extended Reality Technologies for Educational Microscopy, EuroVR2020 25-27 November 2020, Valencia, Spain.

Short Description

The main contribution of this work is the introduction of an innovative and interactive educational mobile XR tool/system based on dynamic content for assisting learners in laboratory instrument manipulation. To demonstrate our approaches, we make use of a microscope (and its components) as it composes one of the fundamental instruments of laboratories related to Biology, Physics and Chemistry (Science), which are also known as “wet labs”. Within this framework, the proposed system aims to instruct learners about a microscope’s main components and functionalities. Additionally, it enables users to learn about various laboratory procedures by interacting with the microscope using hand gestures over virtual triggers (single camera-based motion sens- ing technologies). Understanding the need and the importance of the dynamic management of educational content, this system introduces a Web based interface based on link data technologies. It must be stressed that the proposed system also aims at the exploitation of edutainment approaches, setting the standards for increased immersion and presence in the XR environment, stimulating the user’s senses, leading to better understanding of educational material and new skill development.

Tutorial

The following is a video tutorial, presenting the main features of the system as well as a use case senario. Please enable the captions.

The Marker

We choose to use the marker-based AR technology, to take advantage of Virtual Triggers approaches, in order to create a unified system that will exploit the same interaction method in both stereoscopic and full screen mode, enhancing the application’s user friendliness. Thus, the trainee will not be obliged to become familiar with different interaction methods depending the view mode they choose. Download the real-size marker: Link

  • Recommended print size: A4
    •

The Android APK

The system (XR) is aimed for mobile devices, Android and iOS smartphones and tablets, exploiting the advanced capabilities of the Unity game engine and the Vuforia SDK. Download android app, version 8 and above. Link.

  • Requires Internet Connection
  • Mobile device (tablet or smartphone): Android (version 8.1 or higher)
  • Full screen View: Landscape mode.
  • Stereoscopic View: AR glasses (e.g. Cardboard)
    •

System exploitation

The exploitation of the proposed system by the learner in educational processes focuses on three different aspects:

Home practicing

As a preparation tool before the interaction with the physical labor- atory instruments, which allows learners to repeat the experiment without con- straints.

Instrument guide

The learner may exploit the XR systems during the real experiment in the physical laboratory for further information or to recall some elements of the instrument..

Continuous knowledge update/lifelong learning

without any restrictions, out of courses or training sessions and available for anyone.

"Microscope exploration" and "Microscopy" Modes

The following two tables present the information provided throught the system about the microscope in the two different modes.

"Microscope exploration" mode

The description of the function of each part of a photonic microscope

id Microscope Part Function
p1 Light switch button Button that switches on and of the light source.
p2 Light intensity knob Knob that regulates the light intensity of the light source.
p3 Diaphragm (Iris) lever Lever that adjusts the diameter of the diaphragm.
p4< Condenser lens knob Knob that moves the condenser lens up and down.
p5 Revolving nosepiece Revolving nosepiece with four objective lenses.
p6 Specimen The sample used in the microscopy procedure.
p7 Eyepieces The user enters the microscopy mode by looking through the eyepieces.
p8 Stage Knob Knob that moves the stage front-to back.
p9 Specimen holder knob Knob that moves the specimen left or right.
p10 Coarse focusing knob Knob that moves the stage up and down. It is used to bring the specimen into sharp focus.
p11 Fine adjustment knob The fine adjustment knob moves gently the stage up and down to bring the specimen into sharp focus.

"Microscopy" mode

A basic step-by step microscopy procedure

Step Step Instruction
sp1 Press the p1 to turn the light on.
sp2 Rotate the p2 to the right, all the way to 18.
sp3 Move the p3 all the way to the left.
sp4 Rotate the p4 to lift the condenser lens up to its highest point.
sp5 Rotate the p5 so as to set the shortest objective lens (4X) into position.
sp6 Place the p6 on the stage.
sp7 Rotate the p7 to adjust them.
sp8 Rotate the p8 left or right to place the specimen in the visual field.
sp9 Rotate the p9 left or right, so as to place the specimen in the visual field.
sp10 Rotate the p10 to move the stage upwards until the image comes into focus.
sp11 (2nd time) Rotate the p5 so as to set the objective lens 10X into position.
sp12 Rotate the p11 to move gently the stage until the image comes into focus.
sp13 (3rd time) Rotate the p5 so as to set the objective lens 40X into position.
sp14 (2nd time) Rotate the p11 to move gently the stage until the image comes into focus.

Get in touch

ATHENA - Research and Innovation Centre in Information, Communication and Knowledge Technologies.

  • Address

    University Campus at Kimmeria, PO BOX 159, GR-67100
    Xanthi, Greece

  • Email

    info@ipet.gr

  • Phone

    (+30) 2541078787
This work is part of the XRLabs (Virtual laboratories using interactive technologies in virtual, mixed and augmented reality environments) project (MIS 5038608) implemented under the Action for the Strategic Development on the Research and Technological Sector, co-financed by national funds through the Operational programme of Western Greece 2014-2020 and European Union funds (European Regional Development Fund)