Automatic generation of ontology from the Deep Web

Jung An Yoo, James Geller, Yi Ta Wu, Ae Chun Soon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

32 Scopus citations

Abstract

The term "Deep Web" refers to Web pages that are not accessible to search engines, e.g., because those Web pages are dynamically generated in response to queries through Web forms or Web services. The existing automated Web crawlers cannot index these pages, thus they are hidden from the Web search engines. Our goal is to properly annotate such Deep Web services (i.e. content generation interfaces of hidden Web sources) with semantic indexing by constructing domain-specific ontologies to represent the contents of the Deep Web sources. The fully automatic derivation of ontologies from Web sources without human review is to date a challenging research issue. We present a novel approach to automatically building a large, yet domain-specific, ontology by interweaving sub-taxonomies of WordNet with domain-specific information extracted from Deep Web service pages. Our algorithms extract domain concepts from Deep Web sources which are augmented with concepts and relationships from WordNet to construct ontology fragments. Structurally, these are Directed Acyclic Graphs (DAGs). An iterative process of extracting WordNet concepts and relationships and bridging concept gaps is used to tie together disparate domain concepts and ontology fragments into one ontology. Using eight domains (airfares, jobs, etc.) from a well-known test-bed, our algorithms constructed an ontology of 1692 concepts from Deep Web sources and 4434 concepts from WordNet. This ontology is expressed in the OWL format to support semantic Web searches.

Original languageEnglish (US)
Title of host publicationProceedings DEXA 2007 18th International Workshop on Database and Expert Systems Applications
Pages470-474
Number of pages5
DOIs
StatePublished - Dec 1 2007
EventDEXA 2007 18th International Workshop on Database and Expert Systems Applications - Regensburg, Germany
Duration: Sep 3 2007Sep 7 2007

Publication series

NameProceedings - International Workshop on Database and Expert Systems Applications, DEXA
ISSN (Print)1529-4188

Other

OtherDEXA 2007 18th International Workshop on Database and Expert Systems Applications
Country/TerritoryGermany
CityRegensburg
Period9/3/079/7/07

All Science Journal Classification (ASJC) codes

  • Engineering(all)

Fingerprint

Dive into the research topics of 'Automatic generation of ontology from the Deep Web'. Together they form a unique fingerprint.

Cite this