tree 95b2c157717a24d0bca5d205c45e05ace5e1f21b
parent 7dc566bdc0ef575c31d29caa8cfc1749d44f2883
author luochen01 <cluo8@uci.edu> 1521947042 -0700
committer Luo Chen <cluo8@uci.edu> 1522376281 -0700

[ASTERIXDB-2339] Add a new inverted index merge cursor

- user model changes: no
- storage format changes: no
- interface changes: no

Details:
- Implement a new inverted index merge cursor which uses two priority queues,
one for tokens and one for keys. For each token, we merge their inverted
lists using the key queue. After that, we fetch the next token and merge
their lists again. This reduces unnecessary token comparision a lot.
- Along this change, created a fast path for inverted index bulkloader.
Based on how the token+key pair is created, there is no need to copy
bulkloaded tuple and check whether it's a new token during merge.

Change-Id: I57d039cd7e08033884529a204bff9acffd96d9bb
Reviewed-on: https://asterix-gerrit.ics.uci.edu/2519
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Ian Maxon <imaxon@apache.org>