TY - GEN
T1 - Automatic generation of ontology from the Deep Web
AU - Yoo, Jung An
AU - Geller, James
AU - Wu, Yi Ta
AU - Soon, Ae Chun
PY - 2007
Y1 - 2007
N2 - The term "Deep Web" refers to Web pages that are not accessible to search engines, e.g., because those Web pages are dynamically generated in response to queries through Web forms or Web services. The existing automated Web crawlers cannot index these pages, thus they are hidden from the Web search engines. Our goal is to properly annotate such Deep Web services (i.e. content generation interfaces of hidden Web sources) with semantic indexing by constructing domain-specific ontologies to represent the contents of the Deep Web sources. The fully automatic derivation of ontologies from Web sources without human review is to date a challenging research issue. We present a novel approach to automatically building a large, yet domain-specific, ontology by interweaving sub-taxonomies of WordNet with domain-specific information extracted from Deep Web service pages. Our algorithms extract domain concepts from Deep Web sources which are augmented with concepts and relationships from WordNet to construct ontology fragments. Structurally, these are Directed Acyclic Graphs (DAGs). An iterative process of extracting WordNet concepts and relationships and bridging concept gaps is used to tie together disparate domain concepts and ontology fragments into one ontology. Using eight domains (airfares, jobs, etc.) from a well-known test-bed, our algorithms constructed an ontology of 1692 concepts from Deep Web sources and 4434 concepts from WordNet. This ontology is expressed in the OWL format to support semantic Web searches.
AB - The term "Deep Web" refers to Web pages that are not accessible to search engines, e.g., because those Web pages are dynamically generated in response to queries through Web forms or Web services. The existing automated Web crawlers cannot index these pages, thus they are hidden from the Web search engines. Our goal is to properly annotate such Deep Web services (i.e. content generation interfaces of hidden Web sources) with semantic indexing by constructing domain-specific ontologies to represent the contents of the Deep Web sources. The fully automatic derivation of ontologies from Web sources without human review is to date a challenging research issue. We present a novel approach to automatically building a large, yet domain-specific, ontology by interweaving sub-taxonomies of WordNet with domain-specific information extracted from Deep Web service pages. Our algorithms extract domain concepts from Deep Web sources which are augmented with concepts and relationships from WordNet to construct ontology fragments. Structurally, these are Directed Acyclic Graphs (DAGs). An iterative process of extracting WordNet concepts and relationships and bridging concept gaps is used to tie together disparate domain concepts and ontology fragments into one ontology. Using eight domains (airfares, jobs, etc.) from a well-known test-bed, our algorithms constructed an ontology of 1692 concepts from Deep Web sources and 4434 concepts from WordNet. This ontology is expressed in the OWL format to support semantic Web searches.
UR - http://www.scopus.com/inward/record.url?scp=47849128923&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=47849128923&partnerID=8YFLogxK
U2 - 10.1109/DEXA.2007.43
DO - 10.1109/DEXA.2007.43
M3 - Conference contribution
AN - SCOPUS:47849128923
SN - 0769529321
SN - 9780769529325
T3 - Proceedings - International Workshop on Database and Expert Systems Applications, DEXA
SP - 470
EP - 474
BT - Proceedings DEXA 2007 18th International Workshop on Database and Expert Systems Applications
T2 - DEXA 2007 18th International Workshop on Database and Expert Systems Applications
Y2 - 3 September 2007 through 7 September 2007
ER -