tree 74794798ce64e0b12793d0b44b71b893c38eadda
parent 8076fe97d16d9b2774718739dc39b4961c3b8ea2
author Wail Alkowaileet <wael.y.k@gmail.com> 1541559154 -0800
committer Wail Alkowaileet <wael.y.k@gmail.com> 1541574748 -0800

[ASTERIXDB-2422][STO] Introduce compressed storage

- user model changes: yes
  - Add new configuration in the with-caluse to enable compression
  - Add new nc configuration in the config file
- storage format changes: yes
  - Pages of the primary index can be compressed
  - Add a companion file (Look Aside File) with the compressed index
  - Allow optional values in the LocalResource
  - Add compression information in Metadata.Dataset
- interface changes: yes
  - ICCApplicationContext:
    - Add getCompressionManager()
  - IBufferCache:
    - Add getCompressedFileWriter(int fileId)
  - ICachedPageInternal:
    - Add setCompressedPageOffset(long offset)
    - Add getCompressedPageOffset()
    - Add setCompressedPageSize(int size)
    - Add getCompressedPageSize()

Details:
  - Add new integration test for this patch
  - Fix ASTERIXDB-2464
  - Add ddl-with-clause type validator

Additional details in the design document:
https://cwiki.apache.org/confluence/display/ASTERIXDB/Compression+in+AsterixDB

Change-Id: Idde6f37c810c30c7f1a5ee8bcbc1e3e5f4410031
Reviewed-on: https://asterix-gerrit.ics.uci.edu/2857
Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Murtadha Hubail <mhubail@apache.org>