Gitiles
Code Review
Sign In
asterix-gerrit.ics.uci.edu
/
asterixdb
/
21e672a65d8d2071a57f48e3e81e94103e6f7cfd
/
hyracks-storage-am-common
367564e
Allowing LSM file managers to be initialized with a starting IO device index. Using that mechanism, the first disk component of the i-th partition of an Asterix LSM index is written on the i-th IO device (further components are assigned to IO devices in a round robin fashion).
by alexander.behm
· 12 years ago
20a817c
* The cleanup of the merged components in the LSM indexes is now the responsibility of either: the last existing search thread (in case the merge process is over and there are still search threads accessing the merged components), or the merge thread itself (in case the merge process is over and there are no search threads accessing the merged components). * Allowed concurrent merges to occur at the same time instead of the old design which only allowed one merge process at a time per LSM index.
by salsubaiee
· 12 years ago
6586f78
Added exception handling in the rtree bulkload, to release all latches in case the bulkload failed. The btree bulkload already does that.
by salsubaiee
· 12 years ago
d59755e
Minor amendment to my multicomparator changes.
by alexander.behm
· 12 years ago
da370f6
Finished implementing performance-optimized MultiComparators.
by alexander.behm
· 12 years ago
b9ae24a
Checkpointing progress on implementing a length-partitioned inverted index.
by alexander.behm
· 12 years ago
ef5d900
changes for adding proper search/modification callbacks
by kisskys
· 12 years ago
ded4ffe
Fixed issue in LSM indexes where OS file handles would not be closed properly if destroy() was called after deactivate(). This issue caused 'too many open files' during the Asterix runtime tests on a 32-bit Ubuntu.
by alexander.behm
· 12 years ago
642df06
Added LSM insert/delete operator that uses 'try' operations and partial flushing of Hyracks frames to avoid deadlocks with LSM component flushes.
by alexander.behm
· 12 years ago
e5a55aa
Added 'try' versions of LSM index operations to allow their caller to avoid potential deadlocks involving LSM flushes.
by alexander.behm
· 12 years ago
2fcbbcf
Changed lsm io operation callback such that actions can be taken before and after executing the operation. This mechanism is going to be used by Asterix to inject the last lsn into components.
by alexander.behm
· 12 years ago
13fc5e4
Fixed a space calculation bug in the the btree interior frame split. Formatted the code.
by salsubaiee
· 12 years ago
f4827cf
Changed operation tracker interface and implementations.
by alexander.behm
· 12 years ago
dade609
Changed operation tracker to include an externally called completeOperation() for finally declaring an operation inactive on an lsm index.
by alexander.behm
· 12 years ago
f8775bb
Split IOperationCallbackProvider into ISearchOperationCallbackFactory and IModificationOperationCallbackFactory since we are going to have a variety of implementations for them in Asterix.
by alexander.behm
· 12 years ago
568d40a
Modified operation callback to include the after image in before().
by alexander.behm
· 12 years ago
8671125
Changed the split in the rtree to be non-recursive by making sure the split can successfully insert the new tuple in either split pages assuming tuples are not bigger than half of the page size. Added test cases for the new rtree page split. Fixed a bug in the page header size calculations in btree and rtree.
by salsubaiee
· 12 years ago
390ef9c
Changed the btree page split to use tuples sizes in order to determine which tuples are going to move to the new page and added a test case.
by salsubaiee
· 12 years ago
0cdfd4b
- Changed the tree index interfaces so split return a boolean to indicate if the new tuple has been successfully inserted in either left or right page.
by salsubaiee
· 12 years ago
a8b74c8
added NOOP indexOperation
by kisskys
· 12 years ago
07e6bee
made naming of ILSMIndexAccessor implementations consistent;
by zheilbron
· 12 years ago
d974a5b
merged hyracks_asterix_stabilization -r1913:1947 to hyracks_lsm_tree
by zheilbron
· 12 years ago
949579a
added IInMemoryFreePageManager & IInMemoryBufferCache interfaces
by zheilbron
· 12 years ago
ca7f68d
Removed unused package edu.uci.ics.hyracks.storage.am.common.lifecycle;
by zheilbron
· 12 years ago
d8fc672
replaced the IIndexArtifactMap interface with the ILocalResourceRepository interface
by kisskys
· 12 years ago
739d652
continuing implementing the local resource repository
by kisskys
· 12 years ago
80ef1d4
allowed operation callback methods to throw an exception
by zheilbron
· 12 years ago
3558be6
checkpoint of the local resource repository
by kisskys
· 12 years ago
09ff0db
renamed IIndexOpContext and its methods for clarity
by zheilbron
· 12 years ago
5063fee
added cancel() operation callback method to ISearchOperationCallback to allow for releasal of locks when the reconciled tuple is not found after unlatch and retraverse dance
by zheilbron
· 12 years ago
7935098
exposed IHyracksTaskContext to op callbacks through IOperationCallbackProvider
by zheilbron
· 12 years ago
d543d53
changed IndexDropOperatorDescriptor to inherit from AbstractTreeIndexOpDesc which dataflowhelpers require
by zheilbron
· 12 years ago
654d979
More cleaning. Got rid of an unecessary interface.
by alexander.behm
· 12 years ago
097aa7e
More index operator cleanup for better code sharing with the lsm inverted index.
by alexander.behm
· 12 years ago
b0ceb85
modified provider and factory interfaces to allow access to hyracks task context
by zheilbron
· 12 years ago
6fdd1b0
Minor fixes.
by alexander.behm
· 12 years ago
0a335d6
More index operator cleanup.
by alexander.behm
· 12 years ago
c25df01
First phase of cleaning up index operators for better code sharing.
by alexander.behm
· 12 years ago
0acc2d6
Switched inverted-index operators to lsm-inverted-index. Minor cleaning for better code sharing.
by alexander.behm
· 12 years ago
bb906dc
Merged hyracks_lsm_tree r1860:1879.
by alexander.behm
· 12 years ago
409cced
ensured all tree index operators that implement IFrameWriter properly implement IFrameWriter
by zheilbron
· 12 years ago
8e74f38
changed lifecycle manager to account for memory decrease only if deactivate succeeds
by zheilbron
· 12 years ago
f8e7f24
Fixed incorrect sharing of inverted-list builder causing the multi-threaded tests to break. Finished multi-threading tests.
by alexander.behm
· 12 years ago
444f112
revamped index lifecycle management interfaces to allow for more flexibility (needed in asterix for metadata)
by zheilbron
· 12 years ago
f1b046a
Fixed a few multi-threading issues in the lsm-inverted-index. Still some more to go.
by alexander.behm
· 12 years ago
512869d
Checkpointing lsm-inverted-index multi thread test. Still needs some debugging.
by alexander.behm
· 12 years ago
53f8bc8
Added tests for gram-based indexes, and hashed tokens.
by alexander.behm
· 12 years ago
6740195
Fixed deletion protocol in the lsm-inverted-index. The in-memory deleted-keys BTree now only contains keys referring to on-disk components. Deletions that refer to documents in the in-memory inverted index are physically removed from there, and no entry to the deleted-keys BTree is made. This behavior seems necessary to avoid a pathological case of 'lost deletes' to on-disk components (more details in comments of the code).
by alexander.behm
· 12 years ago
d07dfe0
Merged hyracks_lsm_tree r1846:r1858.
by alexander.behm
· 12 years ago
a851201
reverted r1844
by zheilbron
· 12 years ago
17bbe81
Implemented lsm inverted index range search cursor that is used in merges.
by alexander.behm
· 12 years ago
46c8945
Merged hyracks_lsm_tree r1838:r1844.
by alexander.behm
· 12 years ago
7a4ac20
added interface for deferring the closing of indexes
by zheilbron
· 12 years ago
ddcb83d
Now using two different methods of comparing actual and expected inverted-index contents to exercise more features.
by alexander.behm
· 12 years ago
e5d39b1
Added range search cursor for on-disk inverted index in preparation for implementing merge.
by alexander.behm
· 12 years ago
99cab5b
Added lsm inverted index insert test based on new testing framework.
by alexander.behm
· 12 years ago
78ebcd3
Added basic search test for in-memory inverted index based on new framework. Fixed a few bugs in the in-memory inverted list cursor.
by alexander.behm
· 12 years ago
5d7a0e1
Added first inverted-index search test based on new testing framework. Found and fixed a few bugs.
by alexander.behm
· 12 years ago
167b6ce
Added validation of on-disk inverted index. Added bulk-load test for on-disk inverted index, and insert test for in-memory inverted index based on a new testing framework.
by alexander.behm
· 12 years ago
cb667d0
Started implementation of InvertedIndexTestContext.
by alexander.behm
· 12 years ago
8cc1214
Added data files for document generation.
by alexander.behm
· 12 years ago
1636c05
Added document generator for creating random documents (driven by a dictionary file) whose tokens are zipf distributed. This will be the basis for a unified inverted-index testing framework.
by alexander.behm
· 12 years ago
ef10d07
More cleaning and prepwork.
by alexander.behm
· 12 years ago
b099505
Improved design and significantly reduced object creation of in-memory inverted index.
by alexander.behm
· 12 years ago
dda3d7a
got rid of the IndexRegistry since it is replaced by the index lifecycle manager
by zheilbron
· 12 years ago
b5f8322
added LRU strategy to index lifecycle manager
by zheilbron
· 12 years ago
caa4c61
Added flag for checking whether input to BTree bulk load is sorted or not. Still need to add better tests.
by alexander.behm
· 12 years ago
3b89343
added validate() method for IIndexes. Currently only supported for BTree/LSM-BTree
by zheilbron
· 12 years ago
2c65eae
added documentation for operation callbacks and removed extraneous callback call
by zheilbron
· 12 years ago
43cc425
added IIndex (index lifecycle) documentation and improved clarity of lifecycle related exception messages
by zheilbron
· 12 years ago
1406147
shallow code cleanup for btrees while cataloging todos
by zheilbron
· 12 years ago
d75365d
split flush and merge into two-part calls to allow for IO scheduling
by zheilbron
· 12 years ago
f64599d
exposed interface for index lifecycle management and added naive first implementation
by zheilbron
· 12 years ago
594a3c4
more dataflow helper changes and cleanup to ease the introduction of index lifecycle management
by zheilbron
· 12 years ago
fa6b1c5
moved opcallbacks out of dataflowhelpers and did some minor cleanup
by zheilbron
· 12 years ago
c8fbea0
changed iinIIndex.open and IIndex.close to activate and deactive, respectively
by zheilbron
· 12 years ago
7d88c67
instrumented btree and lsmbtree with search opcallback calls
by zheilbron
· 12 years ago
f91d247
changed index drop operator to be consistent with create operator
by zheilbron
· 12 years ago
4b74391
merged hyracks_asterix_stabilization r1634:1651
by zheilbron
· 12 years ago
a165d0a
implemented proper (and uniform) lifecycle management for all indexes
by zheilbron
· 12 years ago
552c66b
Implemented a HashMultiSet for maintaining the expected results in the R-Tree and LSM R-Tree tests. Dramatically reduces the time for tests.
by alexander.behm
· 12 years ago
dd439f9
forgot file on previous commit
by zheilbron
· 12 years ago
6087964
refactored index interfaces to allow proper lifecycle management
by zheilbron
· 12 years ago
d891d7f
merged hyracks_asterix_stabilization r1596:1599
by zheilbron
· 12 years ago
621f01e
Changed all indexes to use the new bulkload interface
by zheilbron
· 12 years ago
375d5ab
added a mechanism to set resourceId to operationCallback
by kisskys
· 12 years ago
f8d00bd6
added IIndexArtifactMap interface in order to support permanent resourceIds
by kisskys
· 12 years ago
21bfc73
undo the revision r1582 in order not to change the interface of IIndexOperatorDescriptor and all sub-concrete-classes
by kisskys
· 12 years ago
68dc82e
Reintegrated hyracks_rtree_bulkload.
by alexander.behm
· 12 years ago
ee27ab9
added IIndexArtifactMap interface to generate permanent resourceId and changed IIndexOperatorDescriptor to deal with the IIndexArtifactMap
by kisskys
· 12 years ago
3e5d0c73
instrumented rtree with modification callbacks and provided plumbing for opcallbacks to indexes
by zheilbron
· 12 years ago
0723998
instrumented btree and insertupdatedelete operator with modification opcallback calls
by zheilbron
· 12 years ago
f081de2
refactored opcallback interfaces and touchpoints
by zheilbron
· 12 years ago
112770a
fixed rare case bug with update in btree and cleaned up an interface
by zheilbron
· 12 years ago
2b5c3f7
Merged hyracks_asterix_stabilization r1491:r1544.
by alexander.behm
· 12 years ago
165465d
merged hyracks_asterix_stabilization r1453:1468
by zheilbron
· 13 years ago
b1ee09f
merged hyracks_asterix_stabilization r1440:1453
by zheilbron
· 13 years ago
3dd54f5
Removed dependencies on hyracks-control-nc.
by alexander.behm
· 13 years ago
f987cc5
Fixed some pom files that got messed up in previous merge
by zheilbron
· 13 years ago
e74da94
merged r1274:1322 from hyracks_dev_next
by zheilbron
· 13 years ago
Next »