Gitiles
Code Review Sign In
asterix-gerrit.ics.uci.edu / asterixdb / bb36205a5e302c72448e4ae5170bed9104e9d86e / hyracks-storage-am-lsm-common
  1. bb36205 merged hyracks_lsm_tree into branch -r2707:2751 by salsubaiee · 12 years ago
  2. 9bdd380 added force/undo operations to the lsm indexes; enabled proper logging callbacks for secondary indexes by zheilbron · 12 years ago
  3. 27ac9d9 changes towards recovery by kisskys · 12 years ago
  4. aadfa06 merged hyracks_lsm_tree into branch -r2702:2707 by salsubaiee · 12 years ago
  5. b8073f3 fixed bug that caused merge operations not to cleanup merged components by zheilbron · 12 years ago
  6. 81d2b6b Integrated bloom filters with LSM-BTree during flushes, merges, and bulkload. All tests pass except the merge test due to what it seems a bug in the cleanup after merges if there are no search threads accessing the disk components. Next is to use bloom filters during search and also with other lsm indexes. by salsubaiee · 12 years ago
  7. 61a2442 added option to conditionally flush an LSM index when it is being deactivated; added missing file from previous commit by zheilbron · 12 years ago
  8. 874c474 added proper IO Opcallback for when LSM indexes are deactivatd by zheilbron · 12 years ago
  9. 4100d48 major reworking of all lsm indexes with respect to synchronization and interfacing with the lsmharness by zheilbron · 12 years ago
  10. 091dab5 Rename ImmediateScheduler to SynchronousScheduler; by zheilbron · 12 years ago
  11. c1fdccc minor cleanup: fixed typo; swapped sync objects for sync on 'this' by zheilbron · 12 years ago
  12. 5195427 getWrite/ReadDevices returns Set instead of List; by zheilbron · 12 years ago
  13. 2e6edf5 merged the creation and scheduling of flushes and merge IO operations to a single call by zheilbron · 12 years ago
  14. b652d52 removed flush controller; ILSMIndex replaces the functionality by zheilbron · 12 years ago
  15. 367564e Allowing LSM file managers to be initialized with a starting IO device index. Using that mechanism, the first disk component of the i-th partition of an Asterix LSM index is written on the i-th IO device (further components are assigned to IO devices in a round robin fashion). by alexander.behm · 12 years ago
  16. 20a817c * The cleanup of the merged components in the LSM indexes is now the responsibility of either: the last existing search thread (in case the merge process is over and there are still search threads accessing the merged components), or the merge thread itself (in case the merge process is over and there are no search threads accessing the merged components). * Allowed concurrent merges to occur at the same time instead of the old design which only allowed one merge process at a time per LSM index. by salsubaiee · 12 years ago
  17. c4ca146 Restored interface that was mitakenly deleted in r2552. by alexander.behm · 12 years ago
  18. 717e063 Removed two unnecessary methods from the file manager interface. by salsubaiee · 12 years ago
  19. 03b7f53 Refactored the LSM-indexes to use common abstract class. Added new ILSMComponent interface to represents the LSMComponents instead of passing Objects all around the place. Removed the component finalizers classes and cleaned the file manager API. Fixed couple of bugs. Cleaned the code and changed the names of many methods. by salsubaiee · 12 years ago
  20. 8611a83 Fixed a bug introduced in r2413 that leadto LSM searches being executed as 'try' operations. This caused searchers not to wait for flushes, which violates our current CC protocol, and ultimately lead to hanging threads. by alexander.behm · 12 years ago
  21. ef5d900 changes for adding proper search/modification callbacks by kisskys · 12 years ago
  22. b37b40c Interface change to accommodate Asterix' need to properly set LSNs in merged components. by alexander.behm · 12 years ago
  23. 642df06 Added LSM insert/delete operator that uses 'try' operations and partial flushing of Hyracks frames to avoid deadlocks with LSM component flushes. by alexander.behm · 12 years ago
  24. e5a55aa Added 'try' versions of LSM index operations to allow their caller to avoid potential deadlocks involving LSM flushes. by alexander.behm · 12 years ago
  25. 2fcbbcf Changed lsm io operation callback such that actions can be taken before and after executing the operation. This mechanism is going to be used by Asterix to inject the last lsn into components. by alexander.behm · 12 years ago
  26. 3dc682dc Another round of interface changes for the operation tracker. by alexander.behm · 12 years ago
  27. f4827cf Changed operation tracker interface and implementations. by alexander.behm · 12 years ago
  28. dade609 Changed operation tracker to include an externally called completeOperation() for finally declaring an operation inactive on an lsm index. by alexander.behm · 12 years ago
  29. b770379 Made the deleteDirs() method more robust. That method is used to make sure LSM indexes start off a clean directory, and in some cases files were not deleted properly. by alexander.behm · 12 years ago
  30. a8d9a98 removed unnecessary retrying of inserts code from LSMHarness and ILSMIndexes; by zheilbron · 12 years ago
  31. 07e6bee made naming of ILSMIndexAccessor implementations consistent; by zheilbron · 12 years ago
  32. d974a5b merged hyracks_asterix_stabilization -r1913:1947 to hyracks_lsm_tree by zheilbron · 12 years ago
  33. 949579a added IInMemoryFreePageManager & IInMemoryBufferCache interfaces by zheilbron · 12 years ago
  34. ca7f68d Removed unused package edu.uci.ics.hyracks.storage.am.common.lifecycle; by zheilbron · 12 years ago
  35. bf43701 removed spinlock in ReferenceCountingOperationTracker in favor of condition variable by zheilbron · 12 years ago
  36. 09ff0db renamed IIndexOpContext and its methods for clarity by zheilbron · 12 years ago
  37. 2747e4b fixed minor lifecycle bug in LSM search cursors--properly close even if not used for a search by zheilbron · 12 years ago
  38. b0ceb85 modified provider and factory interfaces to allow access to hyracks task context by zheilbron · 12 years ago
  39. 0a335d6 More index operator cleanup. by alexander.behm · 12 years ago
  40. 0acc2d6 Switched inverted-index operators to lsm-inverted-index. Minor cleaning for better code sharing. by alexander.behm · 12 years ago
  41. 7660d93 Properly Using op callbacks in the lsm inverted index. by alexander.behm · 12 years ago
  42. f8e7f24 Fixed incorrect sharing of inverted-list builder causing the multi-threaded tests to break. Finished multi-threading tests. by alexander.behm · 12 years ago
  43. f1b046a Fixed a few multi-threading issues in the lsm-inverted-index. Still some more to go. by alexander.behm · 12 years ago
  44. 53f8bc8 Added tests for gram-based indexes, and hashed tokens. by alexander.behm · 12 years ago
  45. 1284f0c Minor cleanup for better code sharing. by alexander.behm · 12 years ago
  46. 4d21c2c Implemented lsm-inverted-index merge. Added test. by alexander.behm · 12 years ago
  47. 17bbe81 Implemented lsm inverted index range search cursor that is used in merges. by alexander.behm · 12 years ago
  48. 99cab5b Added lsm inverted index insert test based on new testing framework. by alexander.behm · 12 years ago
  49. ff8edcf Added component finalizer for lsm inverted index. Started to implement corresponding index file manager. by alexander.behm · 12 years ago
  50. ef10d07 More cleaning and prepwork. by alexander.behm · 12 years ago
  51. 9f4b5f8 Reworked in-memory inverted index that buffers insertions. Still needs testing. by alexander.behm · 12 years ago
  52. b5f8322 added LRU strategy to index lifecycle manager by zheilbron · 12 years ago
  53. 5bd708b fixed minor bugs in lsm btree search cursor (related to opcallback) and added opcallback tests for BTree and LSM BTree by zheilbron · 12 years ago
  54. 3b89343 added validate() method for IIndexes. Currently only supported for BTree/LSM-BTree by zheilbron · 12 years ago
  55. 330cfa9 fixed LSM search cursor to properly release mem component latches during search opcallback sequence by zheilbron · 12 years ago
  56. 13493b9 added documentation for ILSMOperationTracker by zheilbron · 12 years ago
  57. d64c4ba updated lsm harness to implement its proper interface by zheilbron · 12 years ago
  58. 2392095 LSM indexes now flush upon deactivation (closing), fixing issue 65 by zheilbron · 12 years ago
  59. 4211425 fixed bug in lsm search cursors: reset properly resets the cursors by zheilbron · 12 years ago
  60. d75365d split flush and merge into two-part calls to allow for IO scheduling by zheilbron · 12 years ago
  61. 43126e2 renamed ILSMIOSchedulerProvider to ILSMIOOperationSchedulerProvider to be consistent by zheilbron · 12 years ago
  62. 258a885 abstracted flush and merge operations into lsm io operation for scheduling by zheilbron · 12 years ago
  63. c8fbea0 changed iinIIndex.open and IIndex.close to activate and deactive, respectively by zheilbron · 12 years ago
  64. 7bbb2c1 fixing previous commit by zheilbron · 12 years ago
  65. 98657e0 changed in-memory buffer cache to have calls that explicitly allocate & deallocate (allow gc) by zheilbron · 12 years ago
  66. bc7fe77 changed lsmbtree insert semantics to be true insert rather than upsert by zheilbron · 12 years ago
  67. a165d0a implemented proper (and uniform) lifecycle management for all indexes by zheilbron · 12 years ago
  68. 6087964 refactored index interfaces to allow proper lifecycle management by zheilbron · 12 years ago
  69. 621f01e Changed all indexes to use the new bulkload interface by zheilbron · 12 years ago
  70. 05f0aa0 Added flush controller and operation tracker interfaces for LSM indexes by zheilbron · 12 years ago
  71. 68dc82e Reintegrated hyracks_rtree_bulkload. by alexander.behm · 12 years ago
  72. f081de2 refactored opcallback interfaces and touchpoints by zheilbron · 12 years ago
  73. 748063e separated IO scheduling from flush and merge policies by zheilbron · 12 years ago
  74. 81eb48f added merge policy and minor fixes to flush policy by zheilbron · 12 years ago
  75. 209094e forgot files in last commit :( by zheilbron · 12 years ago
  76. 9c6583f added LSM flush policy interface and dummy/naive impl for hyracks testing by zheilbron · 12 years ago
  77. e077b6c Removed extra/misplaced lsm directory creation call by zheilbron · 13 years ago
  78. 3dd54f5 Removed dependencies on hyracks-control-nc. by alexander.behm · 13 years ago
  79. e74da94 merged r1274:1322 from hyracks_dev_next by zheilbron · 13 years ago
  80. acce7c3 reverted to r1326 by zheilbron · 13 years ago
  81. 416fcd3 Made semantics of LSMBTree.create() consistent with BTree.create(); create resets the index as if it were new by zheilbron · 13 years ago
  82. 5287de0 Using btree upsert in lsmbtree by zheilbron · 13 years ago
  83. 890182a Implemented BTree upsert. Using callback interface for logging. by alexander.behm · 13 years ago
  84. 2f216e3 Finished readthrough and cosmetic cleanup of lsm-common package: by zheilbron · 13 years ago
  85. 5a23956 - Merged interface changes from hyracks_inverted_index_updates by zheilbron · 13 years ago
  86. 1d0f9a6 Moved tree index test framework to hyracks-test-support. Removed JUnit dependency from access method poms. Cleaned up all access method dependencies. by alexander.behm · 13 years ago
  87. 0364b85 Completed consistency checking for components of the LSM B-Tree and LSM R-Tree in open(). by alexander.behm · 13 years ago
  88. e598a47 Added a missing getter method to the RTree. by salsubaiee · 13 years ago
  89. 035a8ba Removed atomic rename for LSM components. Using special value in metadata page of trees to guarantee consistency of written LSM components. When adding a new LSM component, it is forced to disk, and then the special value is force to disk. by alexander.behm · 13 years ago
  90. 854c466 - Fixed various bugs in the RTree concurrency control protocol which caused some searchers to miss some nodes due to concurrent splits. by salsubaiee · 13 years ago
  91. 0e18687 Implemented registration of LSM components via atomic renaming of a temp component. Modified LSMFileNameManager to use IOManager, such that new LSM components are written to IODevices in a round rob in fashion. Added tests using multiple IO devices. by alexander.behm · 13 years ago
  92. 4663e4a Fixed a minor bug in LSMBTree merge. by alexander.behm · 13 years ago
  93. 44d7c07 Implemented new file naming scheme for LSM indexes based on timestamp intervals. Relying on the file names alone, an LSM index can always determine whether an LSM component is valid or not. Still TODO: Implement flushing/merging into a temp file, followed by an atomic rename upon success. by alexander.behm · 13 years ago
  94. b3892c8 Fixed bug in checking expected results of disk-order scan in BTree tests (they still pass). by alexander.behm · 13 years ago
  95. 5606015 Fixed a race between mergers and searchers in LSM indexes. Completed multi-threading tests for LSM B-Tree. by alexander.behm · 13 years ago
  96. 4ee9f67 Fixed a BTree concurrency bug, where an unsafe read lead to releasing the wrong latch type. Adding LSMBTree multi-threading tests (still incomplete). by alexander.behm · 13 years ago
  97. 7222c93 Minor comment changes. by salsubaiee · 13 years ago
  98. 07769de Fixed thread-concurrency issues in tree indexes due to IBinaryComparator not being thread safe anymore. by alexander.behm · 13 years ago
  99. 5b706a5 Factored out thread-concurrency code of LSM-Trees into a common harness. Modified LSMBTree and LSMRTree to use the harness. by alexander.behm · 13 years ago
  100. ed88dc5 Fixed the order of closing and deleting a tree during the cleanup of a merge. by salsubaiee · 13 years ago