User-oriented document summarization through vision-based eye-tracking

Songhua Xu, Hao Jiang, Francis C.M. Lau

Research output: Chapter in Book/Report/Conference proceedingConference contribution

48 Scopus citations


We propose a new document summarization algorithm which is personalized. The key idea is to rely on the attention (reading) time of individual users spent on single words in a document as the essential clue. The prediction of user attention over every word in a document is based on the user's attention during his previous reads, which is acquired via a vision-based commodity eye-tracking mechanism. Once the user's attentions over a small collection of words are known, our algorithm can predict the user's attention over every word in the document through word semantics analysis. Our algorithm then summarizes the document according to user attention on every individual word in the document. With our algorithm, we have developed a document summarization prototype system. Experiment results produced by our algorithm are compared with the ones manually summarized by users as well as by commercial summarization software, which clearly demonstrates the advantages of our new algorithm for user-oriented document summarization.

Original languageEnglish (US)
Title of host publicationProceedingsc of the 13th International Conference on Intelligent User Interfaces, IUI'09
Number of pages10
StatePublished - 2009
Externally publishedYes
Event13th International Conference on Intelligent User Interfaces, IUI'09 - Sanibel Island, FL, United States
Duration: Feb 8 2009Feb 11 2009

Publication series

NameInternational Conference on Intelligent User Interfaces, Proceedings IUI


Other13th International Conference on Intelligent User Interfaces, IUI'09
Country/TerritoryUnited States
CitySanibel Island, FL

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction


  • Commodity eye-tracking
  • Implicit user feedback
  • Personalized discourse abstract
  • User attention
  • User-oriented document summarization


Dive into the research topics of 'User-oriented document summarization through vision-based eye-tracking'. Together they form a unique fingerprint.

Cite this