Gitiles
Code Review Sign In
asterix-gerrit.ics.uci.edu / asterixdb / bb36205a5e302c72448e4ae5170bed9104e9d86e / hyracks-storage-am-common
  1. bb36205 merged hyracks_lsm_tree into branch -r2707:2751 by salsubaiee · 12 years ago
  2. cd9ce32 Made sure bloom filters don't hold latches after insertion is over (pages are still pinned). Changed the bloom filter insertion to use a bulkload-like interface. Changed the bulkload interface for all indexes to accept number of elements hint. Various bug fixes. by salsubaiee · 12 years ago
  3. 27ac9d9 changes towards recovery by kisskys · 12 years ago
  4. 6330ee5 changes towards recovery by kisskys · 12 years ago
  5. 81d2b6b Integrated bloom filters with LSM-BTree during flushes, merges, and bulkload. All tests pass except the merge test due to what it seems a bug in the cleanup after merges if there are no search threads accessing the disk components. Next is to use bloom filters during search and also with other lsm indexes. by salsubaiee · 12 years ago
  6. 8161789 added some comments while reviewing the IndexLifecycleManager by zheilbron · 12 years ago
  7. 4100d48 major reworking of all lsm indexes with respect to synchronization and interfacing with the lsmharness by zheilbron · 12 years ago
  8. 367564e Allowing LSM file managers to be initialized with a starting IO device index. Using that mechanism, the first disk component of the i-th partition of an Asterix LSM index is written on the i-th IO device (further components are assigned to IO devices in a round robin fashion). by alexander.behm · 12 years ago
  9. 20a817c * The cleanup of the merged components in the LSM indexes is now the responsibility of either: the last existing search thread (in case the merge process is over and there are still search threads accessing the merged components), or the merge thread itself (in case the merge process is over and there are no search threads accessing the merged components). * Allowed concurrent merges to occur at the same time instead of the old design which only allowed one merge process at a time per LSM index. by salsubaiee · 12 years ago
  10. 6586f78 Added exception handling in the rtree bulkload, to release all latches in case the bulkload failed. The btree bulkload already does that. by salsubaiee · 12 years ago
  11. d59755e Minor amendment to my multicomparator changes. by alexander.behm · 12 years ago
  12. da370f6 Finished implementing performance-optimized MultiComparators. by alexander.behm · 12 years ago
  13. b9ae24a Checkpointing progress on implementing a length-partitioned inverted index. by alexander.behm · 12 years ago
  14. ef5d900 changes for adding proper search/modification callbacks by kisskys · 12 years ago
  15. ded4ffe Fixed issue in LSM indexes where OS file handles would not be closed properly if destroy() was called after deactivate(). This issue caused 'too many open files' during the Asterix runtime tests on a 32-bit Ubuntu. by alexander.behm · 12 years ago
  16. 642df06 Added LSM insert/delete operator that uses 'try' operations and partial flushing of Hyracks frames to avoid deadlocks with LSM component flushes. by alexander.behm · 12 years ago
  17. e5a55aa Added 'try' versions of LSM index operations to allow their caller to avoid potential deadlocks involving LSM flushes. by alexander.behm · 12 years ago
  18. 2fcbbcf Changed lsm io operation callback such that actions can be taken before and after executing the operation. This mechanism is going to be used by Asterix to inject the last lsn into components. by alexander.behm · 12 years ago
  19. 13fc5e4 Fixed a space calculation bug in the the btree interior frame split. Formatted the code. by salsubaiee · 12 years ago
  20. f4827cf Changed operation tracker interface and implementations. by alexander.behm · 12 years ago
  21. dade609 Changed operation tracker to include an externally called completeOperation() for finally declaring an operation inactive on an lsm index. by alexander.behm · 12 years ago
  22. f8775bb Split IOperationCallbackProvider into ISearchOperationCallbackFactory and IModificationOperationCallbackFactory since we are going to have a variety of implementations for them in Asterix. by alexander.behm · 12 years ago
  23. 568d40a Modified operation callback to include the after image in before(). by alexander.behm · 12 years ago
  24. 8671125 Changed the split in the rtree to be non-recursive by making sure the split can successfully insert the new tuple in either split pages assuming tuples are not bigger than half of the page size. Added test cases for the new rtree page split. Fixed a bug in the page header size calculations in btree and rtree. by salsubaiee · 12 years ago
  25. 390ef9c Changed the btree page split to use tuples sizes in order to determine which tuples are going to move to the new page and added a test case. by salsubaiee · 12 years ago
  26. 0cdfd4b - Changed the tree index interfaces so split return a boolean to indicate if the new tuple has been successfully inserted in either left or right page. by salsubaiee · 12 years ago
  27. a8b74c8 added NOOP indexOperation by kisskys · 12 years ago
  28. 07e6bee made naming of ILSMIndexAccessor implementations consistent; by zheilbron · 12 years ago
  29. d974a5b merged hyracks_asterix_stabilization -r1913:1947 to hyracks_lsm_tree by zheilbron · 12 years ago
  30. 949579a added IInMemoryFreePageManager & IInMemoryBufferCache interfaces by zheilbron · 12 years ago
  31. ca7f68d Removed unused package edu.uci.ics.hyracks.storage.am.common.lifecycle; by zheilbron · 12 years ago
  32. d8fc672 replaced the IIndexArtifactMap interface with the ILocalResourceRepository interface by kisskys · 12 years ago
  33. 739d652 continuing implementing the local resource repository by kisskys · 12 years ago
  34. 80ef1d4 allowed operation callback methods to throw an exception by zheilbron · 12 years ago
  35. 3558be6 checkpoint of the local resource repository by kisskys · 12 years ago
  36. 09ff0db renamed IIndexOpContext and its methods for clarity by zheilbron · 12 years ago
  37. 5063fee added cancel() operation callback method to ISearchOperationCallback to allow for releasal of locks when the reconciled tuple is not found after unlatch and retraverse dance by zheilbron · 12 years ago
  38. 7935098 exposed IHyracksTaskContext to op callbacks through IOperationCallbackProvider by zheilbron · 12 years ago
  39. d543d53 changed IndexDropOperatorDescriptor to inherit from AbstractTreeIndexOpDesc which dataflowhelpers require by zheilbron · 12 years ago
  40. 654d979 More cleaning. Got rid of an unecessary interface. by alexander.behm · 12 years ago
  41. 097aa7e More index operator cleanup for better code sharing with the lsm inverted index. by alexander.behm · 12 years ago
  42. b0ceb85 modified provider and factory interfaces to allow access to hyracks task context by zheilbron · 12 years ago
  43. 6fdd1b0 Minor fixes. by alexander.behm · 12 years ago
  44. 0a335d6 More index operator cleanup. by alexander.behm · 12 years ago
  45. c25df01 First phase of cleaning up index operators for better code sharing. by alexander.behm · 12 years ago
  46. 0acc2d6 Switched inverted-index operators to lsm-inverted-index. Minor cleaning for better code sharing. by alexander.behm · 12 years ago
  47. bb906dc Merged hyracks_lsm_tree r1860:1879. by alexander.behm · 12 years ago
  48. 409cced ensured all tree index operators that implement IFrameWriter properly implement IFrameWriter by zheilbron · 12 years ago
  49. 8e74f38 changed lifecycle manager to account for memory decrease only if deactivate succeeds by zheilbron · 12 years ago
  50. f8e7f24 Fixed incorrect sharing of inverted-list builder causing the multi-threaded tests to break. Finished multi-threading tests. by alexander.behm · 12 years ago
  51. 444f112 revamped index lifecycle management interfaces to allow for more flexibility (needed in asterix for metadata) by zheilbron · 12 years ago
  52. f1b046a Fixed a few multi-threading issues in the lsm-inverted-index. Still some more to go. by alexander.behm · 12 years ago
  53. 512869d Checkpointing lsm-inverted-index multi thread test. Still needs some debugging. by alexander.behm · 12 years ago
  54. 53f8bc8 Added tests for gram-based indexes, and hashed tokens. by alexander.behm · 12 years ago
  55. 6740195 Fixed deletion protocol in the lsm-inverted-index. The in-memory deleted-keys BTree now only contains keys referring to on-disk components. Deletions that refer to documents in the in-memory inverted index are physically removed from there, and no entry to the deleted-keys BTree is made. This behavior seems necessary to avoid a pathological case of 'lost deletes' to on-disk components (more details in comments of the code). by alexander.behm · 12 years ago
  56. d07dfe0 Merged hyracks_lsm_tree r1846:r1858. by alexander.behm · 12 years ago
  57. a851201 reverted r1844 by zheilbron · 12 years ago
  58. 17bbe81 Implemented lsm inverted index range search cursor that is used in merges. by alexander.behm · 12 years ago
  59. 46c8945 Merged hyracks_lsm_tree r1838:r1844. by alexander.behm · 12 years ago
  60. 7a4ac20 added interface for deferring the closing of indexes by zheilbron · 12 years ago
  61. ddcb83d Now using two different methods of comparing actual and expected inverted-index contents to exercise more features. by alexander.behm · 12 years ago
  62. e5d39b1 Added range search cursor for on-disk inverted index in preparation for implementing merge. by alexander.behm · 12 years ago
  63. 99cab5b Added lsm inverted index insert test based on new testing framework. by alexander.behm · 12 years ago
  64. 78ebcd3 Added basic search test for in-memory inverted index based on new framework. Fixed a few bugs in the in-memory inverted list cursor. by alexander.behm · 12 years ago
  65. 5d7a0e1 Added first inverted-index search test based on new testing framework. Found and fixed a few bugs. by alexander.behm · 12 years ago
  66. 167b6ce Added validation of on-disk inverted index. Added bulk-load test for on-disk inverted index, and insert test for in-memory inverted index based on a new testing framework. by alexander.behm · 12 years ago
  67. cb667d0 Started implementation of InvertedIndexTestContext. by alexander.behm · 12 years ago
  68. 8cc1214 Added data files for document generation. by alexander.behm · 12 years ago
  69. 1636c05 Added document generator for creating random documents (driven by a dictionary file) whose tokens are zipf distributed. This will be the basis for a unified inverted-index testing framework. by alexander.behm · 12 years ago
  70. ef10d07 More cleaning and prepwork. by alexander.behm · 12 years ago
  71. b099505 Improved design and significantly reduced object creation of in-memory inverted index. by alexander.behm · 12 years ago
  72. dda3d7a got rid of the IndexRegistry since it is replaced by the index lifecycle manager by zheilbron · 12 years ago
  73. b5f8322 added LRU strategy to index lifecycle manager by zheilbron · 12 years ago
  74. caa4c61 Added flag for checking whether input to BTree bulk load is sorted or not. Still need to add better tests. by alexander.behm · 12 years ago
  75. 3b89343 added validate() method for IIndexes. Currently only supported for BTree/LSM-BTree by zheilbron · 12 years ago
  76. 2c65eae added documentation for operation callbacks and removed extraneous callback call by zheilbron · 12 years ago
  77. 43cc425 added IIndex (index lifecycle) documentation and improved clarity of lifecycle related exception messages by zheilbron · 12 years ago
  78. 1406147 shallow code cleanup for btrees while cataloging todos by zheilbron · 12 years ago
  79. d75365d split flush and merge into two-part calls to allow for IO scheduling by zheilbron · 12 years ago
  80. f64599d exposed interface for index lifecycle management and added naive first implementation by zheilbron · 12 years ago
  81. 594a3c4 more dataflow helper changes and cleanup to ease the introduction of index lifecycle management by zheilbron · 12 years ago
  82. fa6b1c5 moved opcallbacks out of dataflowhelpers and did some minor cleanup by zheilbron · 12 years ago
  83. c8fbea0 changed iinIIndex.open and IIndex.close to activate and deactive, respectively by zheilbron · 12 years ago
  84. 7d88c67 instrumented btree and lsmbtree with search opcallback calls by zheilbron · 12 years ago
  85. f91d247 changed index drop operator to be consistent with create operator by zheilbron · 12 years ago
  86. 4b74391 merged hyracks_asterix_stabilization r1634:1651 by zheilbron · 12 years ago
  87. a165d0a implemented proper (and uniform) lifecycle management for all indexes by zheilbron · 12 years ago
  88. 552c66b Implemented a HashMultiSet for maintaining the expected results in the R-Tree and LSM R-Tree tests. Dramatically reduces the time for tests. by alexander.behm · 12 years ago
  89. dd439f9 forgot file on previous commit by zheilbron · 12 years ago
  90. 6087964 refactored index interfaces to allow proper lifecycle management by zheilbron · 12 years ago
  91. d891d7f merged hyracks_asterix_stabilization r1596:1599 by zheilbron · 12 years ago
  92. 621f01e Changed all indexes to use the new bulkload interface by zheilbron · 12 years ago
  93. 375d5ab added a mechanism to set resourceId to operationCallback by kisskys · 12 years ago
  94. f8d00bd6 added IIndexArtifactMap interface in order to support permanent resourceIds by kisskys · 12 years ago
  95. 21bfc73 undo the revision r1582 in order not to change the interface of IIndexOperatorDescriptor and all sub-concrete-classes by kisskys · 12 years ago
  96. 68dc82e Reintegrated hyracks_rtree_bulkload. by alexander.behm · 12 years ago
  97. ee27ab9 added IIndexArtifactMap interface to generate permanent resourceId and changed IIndexOperatorDescriptor to deal with the IIndexArtifactMap by kisskys · 12 years ago
  98. 3e5d0c73 instrumented rtree with modification callbacks and provided plumbing for opcallbacks to indexes by zheilbron · 12 years ago
  99. 0723998 instrumented btree and insertupdatedelete operator with modification opcallback calls by zheilbron · 12 years ago
  100. f081de2 refactored opcallback interfaces and touchpoints by zheilbron · 12 years ago