What it is about

Writing is a complex human activity. The writer has to compose a coherent message and formulate it in accordance with linguistic rules (grammar, spelling), all the while taking the characteristics of the potential reader into account. The ability to manage all these various mental activities, as well as their time course, can be regarded as an indicator of the writer’s expertise (Alamargot & Chanquoy, 2001). For the cognitive science researchers we are (but also for people interested in these questions), identifying the rules that govern the engagement and course of these mental processes is an essential step towards a greater understanding of writing and processing (Levy & Ransdell, 1996). The Eye and Pen software was designed to help researchers reach this goal (Chesnet & Alamargot, 2005; Alamargot, Chesnet, Dansac & Ros, 2006).
Eye and Pen can be mainly (but not exclusively) used in the context of handwriting studies, whatever the graphic format (from text to drawing). The Eye and Pen software was designed to allow the synchronous recording of handwriting (by means of a digitizing tablet: coordinates and state of the pen) and eye movements (via an optical eye-tracking system: eye coordinates in the task environment). The conjunction of these two signals allows us to study the synchronization between eye and pen movements during pausing and writing periods. For instance, it makes it possible to study not only the visual control of graphomotor execution, but also the reading of the text in order to revise it and the consultation of documentary sources with a view to summarizing them. Eye and Pen allows users to conduct these investigations in a continuous way, without interrupting the activity underway or increasing cognitive load.

In short, this software makes it possible to establish a link between the visual input of writing (gazes on documentary sources and/or text produced so far) and its graphomotor output (pausing and writing phases, drawing). This link can be studied in various situations and media (paper, computer screen, screen tablet, etc.) The Eye and Pen software can be regarded as a type of digital video recorder, which allows users to watch and play-replay the process of graphic generation and associated eye movements as often as they wish.  A semi-automated coding system enables users to characterize and classify ocular and graphomotor events.

Eye and Pen can also be used without an eyetracking device to only record handwriting data, for example, in a school classroom.

Some tablet manufacturer (ask your reseller) also sells true inking pen for their devices. Thus, one may use a sheet of paper (or even a booklet made of many pages) on the tablet. Handwriting situation is then very “natural”, with a subject writing with a pencil on a sheet of paper, the tablet serves as a “place mat” the subject can move to feel comfortable.

Eye and Pen has two different modes of operation:

  • the acquisition mode, allowing the recording of data and stimuli presentation (audio, video, text, picture);
  • the analysis mode, allowing to display, select (with various filters) and edit data  (in text format, to be imported into spreadsheet or statistical analysis  software).


The “official” citation of Eye and Pen is:

Alamargot, D., Chesnet, D., Dansac, C. & Ros, C. (2006). Eye and Pen: a new device to study reading during writing. Behaviour Research Methods, Instruments and Computers, 38(2), 287-299.

 

Who we are

The authors of Eye and Pen 1 and 2:

  • David Chesnet is a computer engineer at the Maison des Sciences de l’Homme et de la Société of the University of Poitiers (USR 3565 CNRS),
  • Denis Alamargot: was formerly senior lecturer at the CeRCA laboratory (UMR 7295 CNRS and University of Poitiers), now professor, researcher in developmental cognitive psychology at the laboratory Cognition Humaine & Artificielle (CHart) of the University of Paris Est Créteil (EA4004) .

Picture credits: most of the pictures on this site are from Yves Almecija (CeRCA, UMR 7295 CNRS)

 

 

MSHS 5, Avenue Théodore Lefebvre
TSA 21103
F – 86073 Poitiers cedex 9
Tél. +33 (0)5 49 45 46 00
Fax : + 33 (0)5 49 45 46 47
Laboratoire CHArt-UPEC (EA 4004)
Equipe “Sciences Cognitives et Education”
ESPE de l’Académie de Créteil – Université de Paris-Est Créteil
Rue Jean-Macé 94380 Bonneuil sur Marne
       
Web: www.mshs.univ-poitiers.fr Web:www.cognition-usages.org/chart2/

 

About the future

Eye and Pen is a software that evolve with its users.

This means that it was built in function of our research goals (and those of our partners) and it will be enhanced to fulfill the needs of the greatest possible number of users.

The Keep in toucht page hosts a contact form which can be used to submit features requests. Depending on the requests, the amount of work required to implement them and of the coherence between these requests and the software’s objectives, we may release a software update as a “patch” (uploaded into the “Updates” section of  the “Downloads” menu) or register and “prioritize” requests to treat them later as a “bloc” to release an Eye and Pen  upgrade.

The list of supported eyetrackers is thin, but any unsupported eyetracker may become supported. If you’re interested in Eye and Pen, but your device is not supported, please get in touch with us (via email to the support) !


The “Roadmap” lists enhancements we plan to add to Eye and Pen. Some are drawn from requests and suggestions from users

Roadmap to version 4.0

  • Fully integrate “In Air” data into data processing
  • Technical update: network component and graphs component
  • record more descriptive data within TAB samples ( Z, Azimuth, Altitude et Twist)
  • Add ability to correct acqusition defects: tablet roration
  • Add ability to correct acqusition defects: split / merge files
  • Add option to exclude the first pause in “Tracing dynamics” data extraction.
  • Calculate the number of inversion in velocity (NIV)
  • Enhance TAB samples timestamps correction
  • Add a module to work on production bursts
  • Technica enhancement to better analyse the quality of data provided by equipements
  • Add unicode support

Roadmap to version 3.0

  • Freely give away Eye and Pen
  • Get an element into an item of the list
  • Capture a portion of the display
  • Ability to add one’s own text into a session log file
  • Add an optional pictures preloading
  • Add a “template” to help labelling sequences
  • Enhance handwriting samples timing liability
  • Simultaneous voice recording while writing
  • Discontinue support for Eyeputer (Alphabio)
  • Add diagram showing sequences of writing and pausing, eye movements and fixations
  • Increase the range of available codes, AOI and sequences that can be used
  • Simplify files management
  • Record “in the air” pen movements
  • Add data input/output throught the parallel port

Roadmap to version 2.0

System/Hardware

  • TabletPC support through Microsoft TabletPC API (Windows XP TabletPC Edition, Windows Vista).
  • Windows Vista/Seven compatibility
  • Support of Wacom new Intuos4 tablet series (2048 pressure levels)

Acquisition

  • ability to perform an acquistion without a tablet
  • manage acquisition on mutiple computers through network
  • applying “special effect” to the trace displayed on screen while recording: blur.
  • applying “special effect” to screen readability : masking.
  • ability to record tablet as an eyetracker (pen movement is recorded, even if  “up”)
  • audio recording of subject’s retrospective comments.
  • Script: syntax checking
  • script: randomizable list of stimuli management
  • script: variables usage
  • support of more images formats

Analysis

  • replay animation and animation speed management
  • having Eye and Pen drived by an external software, to allow repetitive tasks (extractions etc…).
  • Word clipping tool to generate sequences, AOIs and codings
  • sequences importation/exportation
  • uniformization of data extractions