Gitiles
Code Review Sign In
asterix-gerrit.ics.uci.edu / asterixdb / f3436a98122189559d5c3e1b24abb279255f74f3 / hyracks-storage-am-lsm-rtree / src / main
  1. 9124c69 Fixed a bug in the lsm-btree range search cursor where "proceed" is called unnecessarily twice for the first tuple that satisfy the search predicate. Modified the existing search call back test case to cover the fix of locking anti-matter tuples. by salsubaiee · 12 years ago
  2. e753d7f Minor changes based on Zack's code review. by salsubaiee · 12 years ago
  3. d125c24 Fixed the issue of not locking in-memory anti-mattered tuples in the LSM_BTree range cursor which may result in reading un-committed data. by salsubaiee · 12 years ago
  4. 6204e6b Fixed a bug where the lsm rtree search cursor was not resetting correctly when it is closed and re-opened again. Minor variable renaming. by salsubaiee · 12 years ago
  5. 06d8a8f All lsm indexes (BTree, RTree, and inverted index) are now using bloom filters whenever possible. by salsubaiee · 12 years ago
  6. bb36205 merged hyracks_lsm_tree into branch -r2707:2751 by salsubaiee · 12 years ago
  7. cd9ce32 Made sure bloom filters don't hold latches after insertion is over (pages are still pinned). Changed the bloom filter insertion to use a bulkload-like interface. Changed the bulkload interface for all indexes to accept number of elements hint. Various bug fixes. by salsubaiee · 12 years ago
  8. 9bdd380 added force/undo operations to the lsm indexes; enabled proper logging callbacks for secondary indexes by zheilbron · 12 years ago
  9. 27ac9d9 changes towards recovery by kisskys · 12 years ago
  10. 81d2b6b Integrated bloom filters with LSM-BTree during flushes, merges, and bulkload. All tests pass except the merge test due to what it seems a bug in the cleanup after merges if there are no search threads accessing the disk components. Next is to use bloom filters during search and also with other lsm indexes. by salsubaiee · 12 years ago
  11. 61a2442 added option to conditionally flush an LSM index when it is being deactivated; added missing file from previous commit by zheilbron · 12 years ago
  12. 874c474 added proper IO Opcallback for when LSM indexes are deactivatd by zheilbron · 12 years ago
  13. 4100d48 major reworking of all lsm indexes with respect to synchronization and interfacing with the lsmharness by zheilbron · 12 years ago
  14. c1fdccc minor cleanup: fixed typo; swapped sync objects for sync on 'this' by zheilbron · 12 years ago
  15. 5195427 getWrite/ReadDevices returns Set instead of List; by zheilbron · 12 years ago
  16. 2e6edf5 merged the creation and scheduling of flushes and merge IO operations to a single call by zheilbron · 12 years ago
  17. b652d52 removed flush controller; ILSMIndex replaces the functionality by zheilbron · 12 years ago
  18. 367564e Allowing LSM file managers to be initialized with a starting IO device index. Using that mechanism, the first disk component of the i-th partition of an Asterix LSM index is written on the i-th IO device (further components are assigned to IO devices in a round robin fashion). by alexander.behm · 12 years ago
  19. 20a817c * The cleanup of the merged components in the LSM indexes is now the responsibility of either: the last existing search thread (in case the merge process is over and there are still search threads accessing the merged components), or the merge thread itself (in case the merge process is over and there are no search threads accessing the merged components). * Allowed concurrent merges to occur at the same time instead of the old design which only allowed one merge process at a time per LSM index. by salsubaiee · 12 years ago
  20. 03b7f53 Refactored the LSM-indexes to use common abstract class. Added new ILSMComponent interface to represents the LSMComponents instead of passing Objects all around the place. Removed the component finalizers classes and cleaned the file manager API. Fixed couple of bugs. Cleaned the code and changed the names of many methods. by salsubaiee · 12 years ago
  21. e6df8f1 Fixed a few remaining issues regarding closing of OS file handles. by alexander.behm · 12 years ago
  22. ded4ffe Fixed issue in LSM indexes where OS file handles would not be closed properly if destroy() was called after deactivate(). This issue caused 'too many open files' during the Asterix runtime tests on a 32-bit Ubuntu. by alexander.behm · 12 years ago
  23. 2fcbbcf Changed lsm io operation callback such that actions can be taken before and after executing the operation. This mechanism is going to be used by Asterix to inject the last lsn into components. by alexander.behm · 12 years ago
  24. 3dc682dc Another round of interface changes for the operation tracker. by alexander.behm · 12 years ago
  25. f4827cf Changed operation tracker interface and implementations. by alexander.behm · 12 years ago
  26. a8d9a98 removed unnecessary retrying of inserts code from LSMHarness and ILSMIndexes; by zheilbron · 12 years ago
  27. 07e6bee made naming of ILSMIndexAccessor implementations consistent; by zheilbron · 12 years ago
  28. 949579a added IInMemoryFreePageManager & IInMemoryBufferCache interfaces by zheilbron · 12 years ago
  29. ca7f68d Removed unused package edu.uci.ics.hyracks.storage.am.common.lifecycle; by zheilbron · 12 years ago
  30. 09ff0db renamed IIndexOpContext and its methods for clarity by zheilbron · 12 years ago
  31. 601fbbc exposed interface for supplying LSM RTree with a linearizer by zheilbron · 12 years ago
  32. a2789c4 fixed bug in index lifecycle: create() clears the in-memory state of an index instance as it should by zheilbron · 12 years ago
  33. 654d979 More cleaning. Got rid of an unecessary interface. by alexander.behm · 12 years ago
  34. b0ceb85 modified provider and factory interfaces to allow access to hyracks task context by zheilbron · 12 years ago
  35. 0acc2d6 Switched inverted-index operators to lsm-inverted-index. Minor cleaning for better code sharing. by alexander.behm · 12 years ago
  36. bb906dc Merged hyracks_lsm_tree r1860:1879. by alexander.behm · 12 years ago
  37. 444f112 revamped index lifecycle management interfaces to allow for more flexibility (needed in asterix for metadata) by zheilbron · 12 years ago
  38. f1b046a Fixed a few multi-threading issues in the lsm-inverted-index. Still some more to go. by alexander.behm · 12 years ago
  39. 53f8bc8 Added tests for gram-based indexes, and hashed tokens. by alexander.behm · 12 years ago
  40. 86d2866 First steps to getting delete working. by alexander.behm · 12 years ago
  41. 4d21c2c Implemented lsm-inverted-index merge. Added test. by alexander.behm · 12 years ago
  42. 17bbe81 Implemented lsm inverted index range search cursor that is used in merges. by alexander.behm · 12 years ago
  43. ff8edcf Added component finalizer for lsm inverted index. Started to implement corresponding index file manager. by alexander.behm · 12 years ago
  44. ef10d07 More cleaning and prepwork. by alexander.behm · 12 years ago
  45. 9f4b5f8 Reworked in-memory inverted index that buffers insertions. Still needs testing. by alexander.behm · 12 years ago
  46. f6af864 removed traces of search op callback in RTrees by zheilbron · 12 years ago
  47. b5f8322 added LRU strategy to index lifecycle manager by zheilbron · 12 years ago
  48. caa4c61 Added flag for checking whether input to BTree bulk load is sorted or not. Still need to add better tests. by alexander.behm · 12 years ago
  49. 3b89343 added validate() method for IIndexes. Currently only supported for BTree/LSM-BTree by zheilbron · 12 years ago
  50. 43cc425 added IIndex (index lifecycle) documentation and improved clarity of lifecycle related exception messages by zheilbron · 12 years ago
  51. 2392095 LSM indexes now flush upon deactivation (closing), fixing issue 65 by zheilbron · 12 years ago
  52. 4211425 fixed bug in lsm search cursors: reset properly resets the cursors by zheilbron · 12 years ago
  53. d75365d split flush and merge into two-part calls to allow for IO scheduling by zheilbron · 12 years ago
  54. 43126e2 renamed ILSMIOSchedulerProvider to ILSMIOOperationSchedulerProvider to be consistent by zheilbron · 13 years ago
  55. 258a885 abstracted flush and merge operations into lsm io operation for scheduling by zheilbron · 13 years ago
  56. f64599d exposed interface for index lifecycle management and added naive first implementation by zheilbron · 13 years ago
  57. 594a3c4 more dataflow helper changes and cleanup to ease the introduction of index lifecycle management by zheilbron · 13 years ago
  58. c8fbea0 changed iinIIndex.open and IIndex.close to activate and deactive, respectively by zheilbron · 13 years ago
  59. 7bbb2c1 fixing previous commit by zheilbron · 13 years ago
  60. 98657e0 changed in-memory buffer cache to have calls that explicitly allocate & deallocate (allow gc) by zheilbron · 13 years ago
  61. 7d88c67 instrumented btree and lsmbtree with search opcallback calls by zheilbron · 13 years ago
  62. 196c2c4 added lifecycle tests for rtrees, btrees, lsmbtrees, and lsmrtrees... resolving issue 9 by zheilbron · 13 years ago
  63. a165d0a implemented proper (and uniform) lifecycle management for all indexes by zheilbron · 13 years ago
  64. 6087964 refactored index interfaces to allow proper lifecycle management by zheilbron · 13 years ago
  65. 621f01e Changed all indexes to use the new bulkload interface by zheilbron · 13 years ago
  66. 05f0aa0 Added flush controller and operation tracker interfaces for LSM indexes by zheilbron · 13 years ago
  67. 68dc82e Reintegrated hyracks_rtree_bulkload. by alexander.behm · 13 years ago
  68. 3e5d0c73 instrumented rtree with modification callbacks and provided plumbing for opcallbacks to indexes by zheilbron · 13 years ago
  69. 0723998 instrumented btree and insertupdatedelete operator with modification opcallback calls by zheilbron · 13 years ago
  70. f081de2 refactored opcallback interfaces and touchpoints by zheilbron · 13 years ago
  71. 81eb48f added merge policy and minor fixes to flush policy by zheilbron · 13 years ago
  72. 753f630 exposed flush policy interfaces properly to layers above by zheilbron · 13 years ago
  73. 9c6583f added LSM flush policy interface and dummy/naive impl for hyracks testing by zheilbron · 13 years ago
  74. 165465d merged hyracks_asterix_stabilization r1453:1468 by zheilbron · 13 years ago
  75. 3dd54f5 Removed dependencies on hyracks-control-nc. by alexander.behm · 13 years ago
  76. 816d042 Added in-memory sorting algorithm for the in memory RTree to be used prior to flushing. by salsubaiee · 13 years ago
  77. acce7c3 reverted to r1326 by zheilbron · 13 years ago
  78. ea80af0 Changed the resourceId(which was fileId) value into a persistent value. by kisskys · 13 years ago
  79. 5287de0 Using btree upsert in lsmbtree by zheilbron · 13 years ago
  80. 890182a Implemented BTree upsert. Using callback interface for logging. by alexander.behm · 13 years ago
  81. b84584b Fixed superfluous file creation in LSM B-Tree and LSM R-Tree integration tests. by alexander.behm · 13 years ago
  82. 2f216e3 Finished readthrough and cosmetic cleanup of lsm-common package: by zheilbron · 13 years ago
  83. 5a23956 - Merged interface changes from hyracks_inverted_index_updates by zheilbron · 13 years ago
  84. c8f86a6 Refactored the integration tests and added integration tests for the LSMRTree. by salsubaiee · 13 years ago
  85. 2661ec4 Added LSMRTree search operator. by salsubaiee · 13 years ago
  86. c2db1ea - Fixed a potential bug in the RTree delete that could happen when a deleter latch the root page while it is leaf and when it wants to upgrade the latch to write latch the root is no longer a leaf page. by salsubaiee · 13 years ago
  87. f09b683 Fixed a bug in the LSMRTree delete operation reported by Markus in issue 58. For each delete operation we need to make sure that we run a true in-memory RTree delete operation to avoid return duplicate keys in case of consequent inserts and deletes for the same tuple before flush occur. by salsubaiee · 13 years ago
  88. 96712d3 Fixed a bug in the LSMRTree search cursor related to the timing of opening the RTree cursors which can cause deadlocks. by salsubaiee · 13 years ago
  89. 0364b85 Completed consistency checking for components of the LSM B-Tree and LSM R-Tree in open(). by alexander.behm · 13 years ago
  90. 035a8ba Removed atomic rename for LSM components. Using special value in metadata page of trees to guarantee consistency of written LSM components. When adding a new LSM component, it is forced to disk, and then the special value is force to disk. by alexander.behm · 13 years ago
  91. 854c466 - Fixed various bugs in the RTree concurrency control protocol which caused some searchers to miss some nodes due to concurrent splits. by salsubaiee · 13 years ago
  92. 0e18687 Implemented registration of LSM components via atomic renaming of a temp component. Modified LSMFileNameManager to use IOManager, such that new LSM components are written to IODevices in a round rob in fashion. Added tests using multiple IO devices. by alexander.behm · 13 years ago
  93. 44d7c07 Implemented new file naming scheme for LSM indexes based on timestamp intervals. Relying on the file names alone, an LSM index can always determine whether an LSM component is valid or not. Still TODO: Implement flushing/merging into a temp file, followed by an atomic rename upon success. by alexander.behm · 13 years ago
  94. 5606015 Fixed a race between mergers and searchers in LSM indexes. Completed multi-threading tests for LSM B-Tree. by alexander.behm · 13 years ago
  95. e7aaf0d - Added LSMRTree test framework. by salsubaiee · 13 years ago
  96. eaebc0d Committed, so Alex can put some changes to avoid conflicts. by salsubaiee · 13 years ago
  97. 44637c1 - Fixed a bug in the LSMRTree search cursor which caused returning corrputed tuples. by salsubaiee · 13 years ago
  98. 07769de Fixed thread-concurrency issues in tree indexes due to IBinaryComparator not being thread safe anymore. by alexander.behm · 13 years ago
  99. 5b706a5 Factored out thread-concurrency code of LSM-Trees into a common harness. Modified LSMBTree and LSMRTree to use the harness. by alexander.behm · 13 years ago
  100. 7b5eb1b Added copyright notice. by salsubaiee · 13 years ago