Query Dictionary for Frequent Non-Indexed Queries in HTAP Databases

Shetty, Sucharita and Rao, Dinesh B and Prabhu, Srikanth (2022) Query Dictionary for Frequent Non-Indexed Queries in HTAP Databases. IEEE Access, 10. pp. 23140-23151. ISSN 2169-3536

[img] PDF
14912.pdf - Published Version
Restricted to Registered users only

Download (5MB) | Request a copy
Official URL: https://creativecommons.org/licenses/by/4.0/


The increasing demand for the simultaneous transaction and review of the data for either decision making or forecasting has created a need for faster and better Hybrid Transactional/Analytical Processing (HTAP). This paper emphasizes the speedup of Online Analytical Processing (OLAP) operations in an HTAP environment where analytical queries are mainly repetitive and contain non-indexed keys as their predicates. Zone maps and materialized views are popular approaches adopted by more extensive databases to address this issue. However, they are absent in in-memory databases because of space constraints. Instead, in-memory databases load the cache with result pages of frequently accessed queries. Increasing the number of such queries can fill the cache and raise the system’s overhead. This paper presents Query_Dictionary, a hybrid storage solution that leverages the full capabilities of SQLite by retaining less information of repeti�tive queries in the cache and efficiently accommodating the newly updated data by the end-user. The solution proposes storing page-level metadata query information for a larger result set and row-level information for a smaller result set. It demonstrates Query_Dictionary capabilities on three types of representative queries: single table, binary join, and transactional queries on non-indexed attributes. In comparison with SQLite, the proposed method performs better

Item Type: Article
Uncontrolled Keywords: Data skipping, materialized views, query rewriting, HTAP database
Subjects: Engineering > MIT Manipal > Computer Science and Engineering
Depositing User: MIT Library
Date Deposited: 12 Jul 2022 04:48
Last Modified: 12 Jul 2022 04:48
URI: http://eprints.manipal.edu/id/eprint/158916

Actions (login required)

View Item View Item