Gitiles
Code Review Sign In
asterix-gerrit.ics.uci.edu / asterixdb / b8b3ccc31e37e186b4773fc3745012afe01ef733 / hyracks-storage-am-lsm-invertedindex
  1. 06d8a8f All lsm indexes (BTree, RTree, and inverted index) are now using bloom filters whenever possible. by salsubaiee · 12 years ago
  2. bb36205 merged hyracks_lsm_tree into branch -r2707:2751 by salsubaiee · 12 years ago
  3. cd9ce32 Made sure bloom filters don't hold latches after insertion is over (pages are still pinned). Changed the bloom filter insertion to use a bulkload-like interface. Changed the bulkload interface for all indexes to accept number of elements hint. Various bug fixes. by salsubaiee · 12 years ago
  4. 9bdd380 added force/undo operations to the lsm indexes; enabled proper logging callbacks for secondary indexes by zheilbron · 12 years ago
  5. 27ac9d9 changes towards recovery by kisskys · 12 years ago
  6. 81d2b6b Integrated bloom filters with LSM-BTree during flushes, merges, and bulkload. All tests pass except the merge test due to what it seems a bug in the cleanup after merges if there are no search threads accessing the disk components. Next is to use bloom filters during search and also with other lsm indexes. by salsubaiee · 12 years ago
  7. 61a2442 added option to conditionally flush an LSM index when it is being deactivated; added missing file from previous commit by zheilbron · 12 years ago
  8. 874c474 added proper IO Opcallback for when LSM indexes are deactivatd by zheilbron · 12 years ago
  9. 4100d48 major reworking of all lsm indexes with respect to synchronization and interfacing with the lsmharness by zheilbron · 12 years ago
  10. c1fdccc minor cleanup: fixed typo; swapped sync objects for sync on 'this' by zheilbron · 12 years ago
  11. 5195427 getWrite/ReadDevices returns Set instead of List; by zheilbron · 12 years ago
  12. 2e6edf5 merged the creation and scheduling of flushes and merge IO operations to a single call by zheilbron · 12 years ago
  13. b652d52 removed flush controller; ILSMIndex replaces the functionality by zheilbron · 12 years ago
  14. 367564e Allowing LSM file managers to be initialized with a starting IO device index. Using that mechanism, the first disk component of the i-th partition of an Asterix LSM index is written on the i-th IO device (further components are assigned to IO devices in a round robin fashion). by alexander.behm · 12 years ago
  15. 20a817c * The cleanup of the merged components in the LSM indexes is now the responsibility of either: the last existing search thread (in case the merge process is over and there are still search threads accessing the merged components), or the merge thread itself (in case the merge process is over and there are no search threads accessing the merged components). * Allowed concurrent merges to occur at the same time instead of the old design which only allowed one merge process at a time per LSM index. by salsubaiee · 12 years ago
  16. 327341b Merged hyracks_asterix_stabilization r2462:r2562. by alexander.behm · 12 years ago
  17. 03b7f53 Refactored the LSM-indexes to use common abstract class. Added new ILSMComponent interface to represents the LSMComponents instead of passing Objects all around the place. Removed the component finalizers classes and cleaned the file manager API. Fixed couple of bugs. Cleaned the code and changed the names of many methods. by salsubaiee · 12 years ago
  18. d59755e Minor amendment to my multicomparator changes. by alexander.behm · 12 years ago
  19. da370f6 Finished implementing performance-optimized MultiComparators. by alexander.behm · 12 years ago
  20. e2e312b Added search modifiers that were moved from Asterix. by alexander.behm · 12 years ago
  21. 85011f4 Small beauty fixes. by alexander.behm · 12 years ago
  22. 8388fd8 Minor fix. by alexander.behm · 12 years ago
  23. 38c6578 Implemented dataflow components for length-partitioned inverted indexes. Added integration test. by alexander.behm · 12 years ago
  24. bbf3930 Changed partitioning field in length-partitioned inverted indexes from integer to short. by alexander.behm · 12 years ago
  25. 71ffa45 Changed the search algorithm for in-memory length-partitioned inverted indexes to only latch one inverted list at a time. by alexander.behm · 12 years ago
  26. 23055f7 Implemented length-partitioned LSM inverted index. Still some cleanup needed. by alexander.behm · 12 years ago
  27. 5161d80 Implemented in-memory component for length-partitioned inverted indexes. by alexander.behm · 12 years ago
  28. ff528ab Refactored code for better sharing. Added new test for on-disk component of length-partitioned inverted index. by alexander.behm · 12 years ago
  29. 0e13a7d Implemented bulk loading and basic search for the on-disk components of length-partitioned inverted indexes. by alexander.behm · 12 years ago
  30. b9ae24a Checkpointing progress on implementing a length-partitioned inverted index. by alexander.behm · 12 years ago
  31. 051c550 First steps in preparing the inverted-index testing framework to deal with length partitioning. by alexander.behm · 12 years ago
  32. 0b7985a Some generalizations to support length filtering. by alexander.behm · 12 years ago
  33. ded4ffe Fixed issue in LSM indexes where OS file handles would not be closed properly if destroy() was called after deactivate(). This issue caused 'too many open files' during the Asterix runtime tests on a 32-bit Ubuntu. by alexander.behm · 12 years ago
  34. 642df06 Added LSM insert/delete operator that uses 'try' operations and partial flushing of Hyracks frames to avoid deadlocks with LSM component flushes. by alexander.behm · 12 years ago
  35. e5a55aa Added 'try' versions of LSM index operations to allow their caller to avoid potential deadlocks involving LSM flushes. by alexander.behm · 12 years ago
  36. 3dc682dc Another round of interface changes for the operation tracker. by alexander.behm · 12 years ago
  37. f4827cf Changed operation tracker interface and implementations. by alexander.behm · 12 years ago
  38. f8775bb Split IOperationCallbackProvider into ISearchOperationCallbackFactory and IModificationOperationCallbackFactory since we are going to have a variety of implementations for them in Asterix. by alexander.behm · 12 years ago
  39. 568d40a Modified operation callback to include the after image in before(). by alexander.behm · 12 years ago
  40. a8d9a98 removed unnecessary retrying of inserts code from LSMHarness and ILSMIndexes; by zheilbron · 12 years ago
  41. 07e6bee made naming of ILSMIndexAccessor implementations consistent; by zheilbron · 12 years ago
  42. c544195 updated versions to 0.2.2-SNAPSHOT by zheilbron · 12 years ago
  43. d974a5b merged hyracks_asterix_stabilization -r1913:1947 to hyracks_lsm_tree by zheilbron · 12 years ago
  44. 949579a added IInMemoryFreePageManager & IInMemoryBufferCache interfaces by zheilbron · 12 years ago
  45. ca7f68d Removed unused package edu.uci.ics.hyracks.storage.am.common.lifecycle; by zheilbron · 12 years ago
  46. d8fc672 replaced the IIndexArtifactMap interface with the ILocalResourceRepository interface by kisskys · 12 years ago
  47. 09ff0db renamed IIndexOpContext and its methods for clarity by zheilbron · 12 years ago
  48. fba23a3 fixed bug in jaccard occurrence threshold computation to always return a positive (non-zero) value by zheilbron · 12 years ago
  49. a2789c4 fixed bug in index lifecycle: create() clears the in-memory state of an index instance as it should by zheilbron · 12 years ago
  50. 097aa7e More index operator cleanup for better code sharing with the lsm inverted index. by alexander.behm · 12 years ago
  51. 86000c3 set ignore properties by zheilbron · 12 years ago
  52. 0a335d6 More index operator cleanup. by alexander.behm · 12 years ago
  53. c25df01 First phase of cleaning up index operators for better code sharing. by alexander.behm · 12 years ago
  54. 0acc2d6 Switched inverted-index operators to lsm-inverted-index. Minor cleaning for better code sharing. by alexander.behm · 12 years ago
  55. 7660d93 Properly Using op callbacks in the lsm inverted index. by alexander.behm · 12 years ago
  56. 0e98fbe Adapted inverted index lifecycle calls to latest interfaces. by alexander.behm · 12 years ago
  57. dbdc0b4 Forgot a file. by alexander.behm · 12 years ago
  58. f8e7f24 Fixed incorrect sharing of inverted-list builder causing the multi-threaded tests to break. Finished multi-threading tests. by alexander.behm · 12 years ago
  59. f1b046a Fixed a few multi-threading issues in the lsm-inverted-index. Still some more to go. by alexander.behm · 12 years ago
  60. 512869d Checkpointing lsm-inverted-index multi thread test. Still needs some debugging. by alexander.behm · 12 years ago
  61. 53f8bc8 Added tests for gram-based indexes, and hashed tokens. by alexander.behm · 12 years ago
  62. 13401ad Improved and fixed a few bugs in the lsm inverted index tests. by alexander.behm · 12 years ago
  63. c809639 Another bugfix. by alexander.behm · 12 years ago
  64. a34f2c8 Small bugfix related to pinning/unpinning papes properly. by alexander.behm · 12 years ago
  65. 6740195 Fixed deletion protocol in the lsm-inverted-index. The in-memory deleted-keys BTree now only contains keys referring to on-disk components. Deletions that refer to documents in the in-memory inverted index are physically removed from there, and no entry to the deleted-keys BTree is made. This behavior seems necessary to avoid a pathological case of 'lost deletes' to on-disk components (more details in comments of the code). by alexander.behm · 12 years ago
  66. d07dfe0 Merged hyracks_lsm_tree r1846:r1858. by alexander.behm · 12 years ago
  67. 6632bec Dealing with deleted keys in search cursors. Tests to follow. by alexander.behm · 12 years ago
  68. a34fb9c Minor bugfix. by alexander.behm · 12 years ago
  69. 12c4a65 Significantly simplified LSMInvertedIndexSearchCursor in preparation to dealing with deletes. by alexander.behm · 12 years ago
  70. 1284f0c Minor cleanup for better code sharing. by alexander.behm · 12 years ago
  71. ac9a3c0 Added basic lsm-inverted-index delete test that validates the index using a range search cursor (sort-merges multiple components and removes deleted entries). Still need to remove deleted entries during regular inverted index searches. by alexander.behm · 12 years ago
  72. 456ee5d Added delete test for in-memory inverted index (only adding key to LSM buddy BTree can lead to false positives, practically impossible to test). Fixed a bug in the counting BTree cursor when dealing with empty pages due to deletes. by alexander.behm · 12 years ago
  73. 86d2866 First steps to getting delete working. by alexander.behm · 12 years ago
  74. 4d21c2c Implemented lsm-inverted-index merge. Added test. by alexander.behm · 12 years ago
  75. 17bbe81 Implemented lsm inverted index range search cursor that is used in merges. by alexander.behm · 12 years ago
  76. bdbe7ff Made changes to inverted index ops according to Zach's latest changes to index lifecycle management. by alexander.behm · 12 years ago
  77. e5d39b1 Added range search cursor for on-disk inverted index in preparation for implementing merge. by alexander.behm · 12 years ago
  78. 3023a59 Minor cleanup. by alexander.behm · 12 years ago
  79. 6053d6e Simplified a bunch of inverted-index interfaces. Added lsm inverted index search test. by alexander.behm · 12 years ago
  80. f25ad72 Added bulk loader for lsm inverted index and test (no multi-bulk-load test yet). by alexander.behm · 12 years ago
  81. 99cab5b Added lsm inverted index insert test based on new testing framework. by alexander.behm · 12 years ago
  82. a36ad67 Almost done with flush operation of lsm inverted index. by alexander.behm · 12 years ago
  83. ff8edcf Added component finalizer for lsm inverted index. Started to implement corresponding index file manager. by alexander.behm · 12 years ago
  84. c5bf2ef Started working on the lifecycle stuff for the LSM inverted index. by alexander.behm · 12 years ago
  85. 7daf2f4 Cleaned up more old tests. by alexander.behm · 12 years ago
  86. 78ebcd3 Added basic search test for in-memory inverted index based on new framework. Fixed a few bugs in the in-memory inverted list cursor. by alexander.behm · 12 years ago
  87. 5d7a0e1 Added first inverted-index search test based on new testing framework. Found and fixed a few bugs. by alexander.behm · 12 years ago
  88. 167b6ce Added validation of on-disk inverted index. Added bulk-load test for on-disk inverted index, and insert test for in-memory inverted index based on a new testing framework. by alexander.behm · 12 years ago
  89. 186b217 Added prefix-search capability for sorted sets of CheckTuples to enable comparing inverted indexes against a baseline inverted index. by alexander.behm · 12 years ago
  90. cb667d0 Started implementation of InvertedIndexTestContext. by alexander.behm · 12 years ago
  91. 0702b39 Moved files. by alexander.behm · 12 years ago
  92. 07f5206 More cleaning and reorg. by alexander.behm · 12 years ago
  93. 132c3b8 Next round of cleanup. by alexander.behm · 12 years ago
  94. 9d3eb62 More renaming and reorganizing. by alexander.behm · 12 years ago
  95. f4404a8 First round of renaming packages, and reorganizing files. by alexander.behm · 12 years ago
  96. 6a2bf49 Moved inverted index code into corresponding lsm projects. by alexander.behm · 12 years ago
  97. ef10d07 More cleaning and prepwork. by alexander.behm · 12 years ago
  98. b099505 Improved design and significantly reduced object creation of in-memory inverted index. by alexander.behm · 12 years ago
  99. 9f4b5f8 Reworked in-memory inverted index that buffers insertions. Still needs testing. by alexander.behm · 12 years ago
  100. 15c4e03 Second initial copy from hyracks_inverted_index_updates. by alexander.behm · 12 years ago