Toward large scale integration: Building a MetaQuerier over databases on the Web

摘要: The Web has been rapidly “deepened” by myriad searchable databases online, where data are hidden behind query interfaces. Toward large scale integration over this “deep Web,” we have building the MetaQuerier system– for both exploring (to find) and integrating query) on Web. As an interim report, first, paper proposes our goal of Web-scale integration– With its dynamic ad-hoc nature, such mandates source discovery on-thefly translation. Second, present system architecture underlying technology key subsystems in ongoing implementation. Third, discuss “lessons” learned to date, focusing efforts integration, putting individual function together. On one hand, observe that, across subsystems, is itself non-trivial– which presents challenges opportunities beyond isolation. other also there emerge unified insights “holistic integration”– leverage as a unique opportunity information integration.