DrillBeyond: Processing Multi-Result Open World SQL Queries uri icon

Open Access

  • false

Peer Reviewed

  • false

Abstract

  • In a traditional relational database management queries can only be defined over attributes defined in the schema, but are guaranteed to give single, definitive answer structured exactly as specified in the query. In contrast, an information retrieval system allows the user to pose queries without knowledge of a. schema, but the result will he a. top-kappa list of possible answers, with no guarantees about the structure Or content, of the retrieved documents.
    In this paper, we present DrillBeyond, a novel TR/RDBMS hybrid system, in which the user seamlessly queries a relational database together with a large corpus of tables extracted from a web crawl. The system allows full SQL queries over the relational database, but additionally allows the user to use arbitrary additional attributes in the query that need not to be defined in the schema. The system then processes this semi-specified query by computing a top-kappa list of possible query evaluations, each based on different candidate web data sources, thus mixing properties of RDBMS and TR systems.
    We design a novel plan operator that encapsulates a web data retrieval and matching system and allows direct integration of such systems into relational query processing. then present methods for efficiently processing multiple variants of a query, by producing plans that are optimized for large invariant intermediate results that can be reused between multiple query evaluations. We demonstrate the viability of the operator and our optimization strategies by implementing them in PostgreSQL and evaluating on a standard benchmark by adding arbitrary attributes to its queries.

Veröffentlichungszeitpunkt

  • Januar 1, 2015