IntelliGaze Installation and Service Manual Ver Nov 2008

Manual Copyright © 2007-2008 alea technologies gmbh. All rights reserved. The Information in this document is subject to change without notice. alea technologies. reserves the right to revise this document and to make changes from time to time in the content hereof without obligation to notify any person or persons of such revisions or changes. This document contains proprietary information which is protected by copyright. All rights are reserved. No part of this document may be photocopied, reproduced or translated to another language without the prior written consent of alea technologies. The software described in this document is supplied under a licence agreement and is protected by international copyright laws. You may copy it only for the purpose of backup and use it only as described in the license agreement.

Security Advice We would like to remind you that the contents of this operating manual do not constitute part of any previous or existing agreement, commitment or legal relationship, or an alteration thereof. All obligations of alea technologies gmbh result from the respective contract of sale, which also includes the complete and exclusively applicable warranty regulations. These contractual warranty regulations are neither extended nor limited by the information contained in this operating manual. Should you require further information on this device, or encounter specific problems that are not discussed in sufficient detail in the operating manual, please contact your specialised dealer or system installer. The device may be connected, taken into operation and maintained only by appropriately qualified personnel. The error-free and safe operation of this device can only be ensured if it is properly transported, stored, sited and assembled, and operated and maintained with due care.

Operating Environment Please observe the proper use of this product. Failure to do so will render the warranty void. Do not subject this product to direct sunlight, moisture or shock. The following environmental conditions are required: Ambient temperature:

0DC ... 45DC (32°F ... 113°F)

Storage temperature:

-20°C ... 60DC (-4°F ... 140DF)

THE INTELLIGAZE SYSTEM IS NOT INTENDED FOR USE IN THE OPERATION OF NUCLEAR FACILITIES, AIRCRAFT NAVIGATION OR COMMUNICATION SYSTEMS, AIR TRAFFIC CONTROL SYSTEMS, LIFE SUPPORT MACHINES OR OTHER EQUIPMENT IN WHICH THE FAILURE OF THE INTELLIGAZE SYSTEM COULD LEAD TO DEATH, PERSONAL INJURY, OR SEVERE PHYSICAL OR ENVIRONMENTAL DAMAGE.

Installation and Maintenance The installation, testing, maintenance and extension of, and any necessary repairs to the system may be performed only by authorized personnel.

Trademarks IntelliGaze and BlickFang are trademarks of alea technologies gmbh. Windows, Windows 95/98/2000/2003, Millennium (ME), XP. Windows NT, Windows CE and Windows Vista are trademarks of Microsoft Corporation. Other products, trademarks or registered trademarks are the property of their respective owners.

Printing History [2008-11-24] Doc.Version

Print Date

---

---

Latest Software Version 1.0

alea technologies gmbh Potsdamer Str. 18a 14513 Teltow – Germany fon: +49 (0)3328 3380 290 fax: +49 (0)3328 3380 299

www.alea-technologies.de [email protected]

Latest Hardware Version 1.0

IntelliGaze Installation & Service Manual

Table of Contents 1 Introduction

5

2 Technical Specification

6

2.1 Tracking System - IG-30

6

3 Safety

7

4 CE Certificate

8

5 Setup

9

5.1 HW-Requirements 9 PC...9 Monitor...10 Tools...11 5.2 Hardware Assembly 11 5.2.1 Hardware Integration Examples 14 5.3 Software 15 Platform Prerequisites ...15 IntelliGaze Software Installation...15 Camera Driver...16 Licensing...17 IntelliGaze Software Update...17 5.4 Monitor Calibration 17 5.5 System Validation 18

6 Using IntelliGaze

19

6.1 Principle of operation 19 6.2 Application Center [AC] 19 6.3 General Use --> see quickstart 20 6.4 Environment 21 6.5 Special Cases 22 Glasses...22 Monocular Operation...22 Calibration area...22 Cerebral Palsy...22

7 IntelliGaze Reference

23

7.1 General 23 7.2 System Hotkeys 24 7.3 Tracking Status Indicator 25 7.4 Mouse 26 7.5 Application Center 27 Application List...28 Add/Edit Application...29 7.6 Calibration 31 7.7 Licensing 33 7.8 Service Mode 34 7.9 Monitor Calibration 37

8

Application Configuration

39

8.1 Windows Desktop Settings 39 8.2 Application Center - General Considerations 40 8.3 AAC Applications 41 The Grid...41 The Grid2...41 Roll-Talk...42

© alea technologies gmbh, 2008

Version: preliminary WIP2008-11-21

3

Introduction

IntelliGaze Installation & Service Manual

MindExpress...42 OnScreenKeys...43 COGAIN – GazeTalk...44 8.4 Games 44 Online Break-Out...44

9 Troubleshooting

46

9.1 General 46 System is not tracking...46 Intelligaze cannot detect camera on start-up...46 9.2 Hardware 48 Cleaning system components...48 Check and adjust lens focus...49 9.3 Software 50

10 Notes

4

51

Version: preliminary WIP2008-11-21

© alea technologies gmbh, 2008

Introduction

IntelliGaze Installation & Service Manual

1 Introduction

© alea technologies gmbh, 2008

Version: preliminary WIP2008-11-21

5

Technical Specification

IntelliGaze Installation & Service Manual

2 Technical Specification 2.1 Tracking System - IG-30 Tracking technology

Hybrid infrared video eye- & head-tracking. Binocular & monocular tracking

Working Volume centered at 600 mm distance

300 x 200 x 200 mm3 [WxHxD]

Accuracy , static

0.5° typically

Accuracy , over full working volume

1° typically

Sampling Rate

50 / 40 / 30 Hz

Max. head-movement velocity

15 cm/s

Recovery-time after tracking loss (head was too fast or moved out of range)

40 ms (@50 Hz)

System Dimensions

ca. 300 x 45 x 80 mm3 [WxHxD]

Mounting Options

on monitor via VESA-adapter on Tablet-PC via customized interfaces

System Weight

ca. 850g

Interface

Full-Speed USB2

Power-Supply

Desktop power supply provided with standard system: prim. 230 / 110 VAC - sec. 15..19V, 3A

Power consumption (50 Hz full tracking mode)

USB: Power-Supply:

ca. 200mA avg. 150mA @15V

Operating Environment Please observe the proper use of this product. Failure to do so will render the warranty void. Do not subject this product to direct sunlight, moisture or shock. The following environmental conditions are required:

Ambient temperature: Storage temperature:

0°C ... 45°C (32°F ... 113°F) -20°C ... 60°C (-4°F ... 140°F)

THE INTELLIGAZE SYSTEM IS NOT INTENDED FOR USE IN THE OPERATION OF NUCLEAR FACILITIES, AIRCRAFT NAVIGATION OR COMMUNICATION SYSTEMS, AIR TRAFFIC CONTROL SYSTEMS, LIFE SUPPORT MACHINES OR OTHER EQUIPMENT IN WHICH THE FAILURE OF THE INTELLIGAZE SYSTEM COULD LEAD TO DEATH, PERSONAL INJURY, OR SEVERE PHYSICAL OR ENVIRONMENTAL DAMAGE.

6

Version: preliminary WIP2008-11-21

© alea technologies gmbh, 2008

Safety

IntelliGaze Installation & Service Manual

3 Safety The IntelliGaze IG-30 system has been certified for general office use as in the class of information and telecommunication devices. The system will meet or exceed the required standard according to the CE certification below. Safety of the Infrared Illumination The IG-30 camera system contains LED sources that emit light in the near infrared (NIR) spectrum. The light emission levels have been measured and calculated to comply with the European laser safety standard EN60825-1. The standards contain test procedures to verify that the emitted light will cause no thermal injury to the eye of a person being exposed to the light. The product is classified as Class 1 LED product and complies with the standards for long-time exposure. Exposure varies with the chosen frame-rate and working distance. For comparison reasons: the user will be exposed to about 200µW/cm² at 40Hz tracking rate in the suggested operating distance of 600mm.

© alea technologies gmbh, 2008

Version: preliminary WIP2008-11-21

7

CE Certificate

IntelliGaze Installation & Service Manual

4 CE Certificate Declaration of Conformity We, alea technologies gmbh Potsdamer Str. 18a, 14513 Teltow, Germany declare under our sole responsibility, that the product IntelliGaze, IG-30, IG-30pro to which this declaration relates is in conformity with the following standards or other normative documents: EN55022:2008 , class B

EMC, emission

EN55024:2003

EMC, Immunity

EN60950

Electrical Safety

EN60825-1

Laser Safety

following the provisions of Directive 89/336/EWG (EMC) and 73/23/EWG (LVD). The IntelliGaze IG-30 system serves as gaze-controlled computer input device for physically handicapped persons. Teltow, July 1st 2008

_______________________________ Wolfgang Lehmann alea technologies gmbh

8

Version: preliminary WIP2008-11-21

© alea technologies gmbh, 2008

Setup

IntelliGaze Installation & Service Manual

5 Setup 5.1 HW-Requirements 5.1.1 PC While every current notebook or desktop PC should be power-full enough to run IntelliGaze in the background, we specify the minimum requirements as follows: CPU:

1,4 GHz, P4 class or higher.

For media operations and gaming we recommend dual-core CPUs. RAM:

XP: VISTA:

512 MB 1 GB

Ports:

1 free full-speed USB2 port.

OS:

Windows XP SP3 Windows VISTA SP1

(1GB recommended) (2GB recommended)



3rd party software that sometimes uses excessive hardware resources while operating in the background, like some virus scanners or similar, can increase the minimum hardware requirements significantly.



Other attached USB devices may negatively influence the gaze tracking performance. Please consider this carefully and whenever possible, test the compatibility in advance. We do highly recommend to connect the camera system to a dedicated USB2 port on the computer rather then through a USB-Hub.



Do not extend the USB cable length longer than 2m. Use only USB2 certified, high quality cables.

© alea technologies gmbh, 2008

Version: preliminary WIP2008-11-21

9

Setup

IntelliGaze Installation & Service Manual

5.1.1 Monitor Technical Requirements Screen size:

12” to 19”wide

Mounting:

VESA75 or VESA100 compatibility (for IG-30 VESA adapter)

In general most monitors that comply with the requirements above should work with the IG-30 system.

small

large

One issue to consider when selecting a monitor is the width of the bottom screen-border (→ see sketch below). A large border, which forces the camera unit further away from the active screen region, might prevent accurate tracking on the upper parts of the screen. In general screens with speakers integrated at the bottom should be avoided for the above reason.

Some VESA-mounts might require a custom spacer or special screws to integrate safely with the standard VESA adapter provided with the IG-30 system. In most cases it is highly recommended to use a monitor arm, like the Ergotron-LX (→ see image) to mount the monitor and camera units as flexibly as possible. Nevertheless, several, in particular height adjustable, desk-mounts allow the integration without the use of a monitor arm. When in doubt , please feel very welcome to ask for our list of recommended monitors, or inquire regarding a particular model before making a purchase. alea technologies will also be pleased to provide you with monitor arms, desktop mounts or customized solutions on request.

10

Version: preliminary WIP2008-11-21

© alea technologies gmbh, 2008

Setup

IntelliGaze Installation & Service Manual

5.1.2 Tools The assembly and service of the system may require several tools: Tool

Part of Demo-Unit

Purpose

Allan / Hex Key 0,9 mm

Yes

CAM-30, re-adjust lens calibration.

Allan / Hex Key 1,5 mm

Yes

CAM-30, fixate housing.

see: p.51 see:p.13

Allan / Hex Key, 2mm

Yes

VESA-Mount, fixate aluminum rods

Metric Ruler or Measuring Tape, 50 cm

No

Monitor Calibration

Screwdriver, div.

No

Depending on Monitor & Arm.

see: p.13

5.2 Hardware Assembly During the hardware installation, the camera and monitor will be combined into a stable module, which may then be mounted on a monitor-arm or desk-stand. We'll only explain the general principle, as the actual process might vary depending on the selected monitor.

Standard TFT & CAM-30 VESA-Adapter Required Tools:

- Screwdriver depending on monitor-arm. - 1,5 mm and 2 mm Allan/Hex keys (provide with the system).

The standard VESA adapter is implemented as a VESA-75&100 spacer. The adapter will be mounted between a typical monitor's VESA-Interface and a monitor-arm. The adapter is 12mm thick and the used screws should be longer accordingly.

© alea technologies gmbh, 2008

Version: preliminary WIP2008-11-21

11

Setup

IntelliGaze Installation & Service Manual

 Please make sure that longer screws do not damage the interior of your monitor ! Monitor-Arm M4 Screws VESA-Mount

Monitor, top

Very slim monitor, or in particular Tablet-PCs, might benefit from using a custom spacer which will allow more space between the VESA-adapter and the front of the device Monitor-Arm M4 Screws VESA-Mount

VESA-'Spacer'

Monitor, top

Once the adapter has been mounted on the back of the monitor, and the monitor has been attached to a monitor-arm or desktop-mount, the aluminum rods can be inserted and roughly adjusted. Please make sure that the monitor is mounted stably and attach the CAM-30 unit underneath by inserting the rods into the appropriated mounting holes in the back of the device. The camera should be adjusted centered and parallel to the front of the monitor, as closely to the bottom of the screen as possible.

12

Version: preliminary WIP2008-11-21

© alea technologies gmbh, 2008

Setup

IntelliGaze Installation & Service Manual

A

A

A

A

A: Thumb-Screw or Screws for 2mm Allan/Hex. Please use limited force for tightening !

After adjusting the vertical distance, the horizontal position should be set. Optionally the camera can be firmly locked in place by tightening the hidden screws [B].

B B B: Hidden Lock-Screws, use 1,5mm Allan/Hex key.

The hardware installation will be completed by connecting the USB-cable to a USB2-port on the PC and connecting the provided power-supply accordingly.



When using USB2 extension cables, please make sure to use USB2 certified cables and that the combined length does not exceed maximum length of 3m. Use USB2 hubs only when required and carefully examine the system performance.

© alea technologies gmbh, 2008

Version: preliminary WIP2008-11-21

13

Setup

IntelliGaze Installation & Service Manual

5.2.1 Hardware Integration Examples 12” PaceBlade Tablet-PC on Wheelchair & Desk-Mount / DAESSY parts

17” TFT-Monitor on Desktop-Mount with Quick-Release / DAESSY parts

15” Panel-PC on Desk-Mount

14

Version: preliminary WIP2008-11-21

© alea technologies gmbh, 2008

Setup

IntelliGaze Installation & Service Manual

5.3 Software 5.3.1 Platform Prerequisites IntelliGaze is designed to work on recent Microsoft Windows platforms. The following operating system and software package requirements must be fulfilled.

•

Windows XP ( SP3 recommended ) or Windows Vista ( SP1 recommended )

•

.Net Framework 3.5 ( will be automatically installed by the IntelliGaze installer if the PC has internet connection, if the framework is not installed and the PC has no internet connection the .Net Framework 3.5 can be installed from the IntelliGaze installation CD )



Please do carefully consider that mobile computers tend to throttle the CPU in idle times and under battery power. Under these conditions, the hardware might no longer meet the above minimum requirements ! Therefore it's highly recommended to turn most power-saving functions off.

Power Options for Windows XP and Windows Vista

5.3.2 IntelliGaze Software Installation The latest version of IntelliGaze can be downloaded here. www.alea-technologies.de → Support → Login -Please use your customer login, which will be provided on request→ Download → Restricted Download



You don't have to be the administrator to operate IntelliGaze however installing it requires administrator rights.

© alea technologies gmbh, 2008

Version: preliminary WIP2008-11-21

15

Setup

IntelliGaze Installation & Service Manual

 Don't connect the camera to the PC before IntelliGaze is installed ! 1. Launch the setup.exe from installation package, there is just one installer for all supported languages. 2. Accept the license agreement. 3. Tick the installation option “IG30 camera system driver” 4. Choose if you want IntelliGaze to be started automatically right after system boot 5. There is now a desktop icon and shortcuts in the program menu.

5.3.1 Camera Driver The driver is being automatically installed with the IntelliGaze software. After the installation of IntelliGaze you may connect the IG30 camera to a USB 2.0 port of your PC.

You are prompted to allow the installation of the driver after the windows hardware detection found the new camera. Whenever you change the camera connection to a port that has never been used before by the camera you will be prompted to allow the installation again. Confirm the security warning to finish the driver installation.

16

Version: preliminary WIP2008-11-21

© alea technologies gmbh, 2008

Setup

IntelliGaze Installation & Service Manual

5.3.2 Licensing The license is handled by the camera system. Refer to chapter 7.7 for more information.

5.3.3 IntelliGaze Software Update You can check the version of IntelliGaze in the settings-version dialog. Please read the release notes of the new version to get a recommendation if an update is reasonable. You will find the file ReleaseNotes.txt in the directory with setup program.

Please uninstall your current version and install the new one.



The update process will not change your program settings.

5.4 Monitor Calibration The last step of the setup process is the calibration of the monitor-camera configuration The monitor calibration requires a metric ruler of about 40 cm. For further details please refer to chapter 7.9.



A badly calibrated monitor will result in inaccurate head-motion compensation and therefore provide inaccurate gaze position measurements.

© alea technologies gmbh, 2008

Version: preliminary WIP2008-11-21

17

Setup

IntelliGaze Installation & Service Manual

5.5 System Validation This step will make sure that all components have been installed correctly and the system is working according to specification. It assumes all setup-steps above have been completed successfully. 1. Connect all cables. At the back of the camera system there is a LED that turns green if the illumination has power. 2. Turn-on the PC and boot Windows. Login. 3. Start IntelliGaze, if not included in 'Autostart' You should see: 1. Dark red shining outer LEDs, the illumination will go to a standby mode if no head was detected for a while. In standby mode the outer LEDs will flash only about once a second. 2. The status windows showing a green or yellow head symbol when the head is within the working range 3. Ctrl + F5 start a calibration ( if the monitor is not calibrated you will get a message that the calibration can't be started) 4. If the system is calibrated you should see the cursor following your gaze.

18

Version: preliminary WIP2008-11-21

© alea technologies gmbh, 2008

Using IntelliGaze

IntelliGaze Installation & Service Manual

6 Using IntelliGaze 6.1 Principle of operation The IntelliGaze system allows the user to control specialized, e.g. AAC applications as well as many standard Windows applications through eye-movements. A camera and illumination system mounted underneath the monitor image the users face under invisible near-infrared illumination. A background PC program analyzes the images in real-time and extracts face and eye locations. Highest resolution image processing algorithms calculate the gaze angle of the users eye. By calculating the intersection point of these gaze-vectors with the screen, the system can determine the gaze location on the screen. Heuristics and configurable filtering are applied to control the mousecursor with the calculated gaze location. Mouseclicks can be triggered by either dwelling on a certain region or blinking. The user may also use external switches or buttons to trigger the click. A new user needs to be calibrated to the system, before the gaze control can be used. The gaze tracking and 'click' control can be adopted to the user requirements and the target application.

6.2 Application Center [AC] The Application Center acts as a configurable Home-Page to the gaze controlled PC. It provides one-look start-up of applications and Windows desktop access. The AC also provides off-screen accessible areas, which control the mouse behavior and allow the run-time adjustment of several system parameters. There are two sides of the AC: 1. The main user interface as homepage for gaze interactions.

2. The 'setup' interface for customization of the gaze interaction.

The configuration menu can be entered by using the tray-icon → setup option.

© alea technologies gmbh, 2008

Version: preliminary WIP2008-11-21

19

Using IntelliGaze

IntelliGaze Installation & Service Manual

Conceptually the AC setup controls all user accessible parameters parameters of the software in several categories: ●

General

-

General Settings and License Status

●

Calibration

-

Calibration parameters

●

Mouse

-

Mouse Parameters for the Windows Desktop

●

Version

-

Version information for all program modules

●

Application Center

-

Setup for the AC 'home-page' client applications and gaze-interaction parameters for each application

6.3 General Use --> see quickstart

20

Version: preliminary WIP2008-11-21

© alea technologies gmbh, 2008