Gitiles
Code Review Sign In
asterix-gerrit.ics.uci.edu / asterixdb / e6484a9514ee436eadeee0c30405f1af55b4b35f / hyracks-storage-am-lsm-invertedindex
  1. e6484a9 Changed operator memory settings. Made some minor perf improvements to inverted index searches. by alexander.behm · 12 years ago
  2. 367564e Allowing LSM file managers to be initialized with a starting IO device index. Using that mechanism, the first disk component of the i-th partition of an Asterix LSM index is written on the i-th IO device (further components are assigned to IO devices in a round robin fashion). by alexander.behm · 12 years ago
  3. 20a817c * The cleanup of the merged components in the LSM indexes is now the responsibility of either: the last existing search thread (in case the merge process is over and there are still search threads accessing the merged components), or the merge thread itself (in case the merge process is over and there are no search threads accessing the merged components). * Allowed concurrent merges to occur at the same time instead of the old design which only allowed one merge process at a time per LSM index. by salsubaiee · 12 years ago
  4. 327341b Merged hyracks_asterix_stabilization r2462:r2562. by alexander.behm · 12 years ago
  5. 03b7f53 Refactored the LSM-indexes to use common abstract class. Added new ILSMComponent interface to represents the LSMComponents instead of passing Objects all around the place. Removed the component finalizers classes and cleaned the file manager API. Fixed couple of bugs. Cleaned the code and changed the names of many methods. by salsubaiee · 12 years ago
  6. d59755e Minor amendment to my multicomparator changes. by alexander.behm · 12 years ago
  7. da370f6 Finished implementing performance-optimized MultiComparators. by alexander.behm · 12 years ago
  8. e2e312b Added search modifiers that were moved from Asterix. by alexander.behm · 12 years ago
  9. 85011f4 Small beauty fixes. by alexander.behm · 12 years ago
  10. 8388fd8 Minor fix. by alexander.behm · 12 years ago
  11. 38c6578 Implemented dataflow components for length-partitioned inverted indexes. Added integration test. by alexander.behm · 12 years ago
  12. bbf3930 Changed partitioning field in length-partitioned inverted indexes from integer to short. by alexander.behm · 12 years ago
  13. 71ffa45 Changed the search algorithm for in-memory length-partitioned inverted indexes to only latch one inverted list at a time. by alexander.behm · 12 years ago
  14. 23055f7 Implemented length-partitioned LSM inverted index. Still some cleanup needed. by alexander.behm · 12 years ago
  15. 5161d80 Implemented in-memory component for length-partitioned inverted indexes. by alexander.behm · 12 years ago
  16. ff528ab Refactored code for better sharing. Added new test for on-disk component of length-partitioned inverted index. by alexander.behm · 12 years ago
  17. 0e13a7d Implemented bulk loading and basic search for the on-disk components of length-partitioned inverted indexes. by alexander.behm · 12 years ago
  18. b9ae24a Checkpointing progress on implementing a length-partitioned inverted index. by alexander.behm · 12 years ago
  19. 051c550 First steps in preparing the inverted-index testing framework to deal with length partitioning. by alexander.behm · 12 years ago
  20. 0b7985a Some generalizations to support length filtering. by alexander.behm · 12 years ago
  21. ded4ffe Fixed issue in LSM indexes where OS file handles would not be closed properly if destroy() was called after deactivate(). This issue caused 'too many open files' during the Asterix runtime tests on a 32-bit Ubuntu. by alexander.behm · 12 years ago
  22. 642df06 Added LSM insert/delete operator that uses 'try' operations and partial flushing of Hyracks frames to avoid deadlocks with LSM component flushes. by alexander.behm · 12 years ago
  23. e5a55aa Added 'try' versions of LSM index operations to allow their caller to avoid potential deadlocks involving LSM flushes. by alexander.behm · 12 years ago
  24. 3dc682dc Another round of interface changes for the operation tracker. by alexander.behm · 12 years ago
  25. f4827cf Changed operation tracker interface and implementations. by alexander.behm · 12 years ago
  26. f8775bb Split IOperationCallbackProvider into ISearchOperationCallbackFactory and IModificationOperationCallbackFactory since we are going to have a variety of implementations for them in Asterix. by alexander.behm · 12 years ago
  27. 568d40a Modified operation callback to include the after image in before(). by alexander.behm · 12 years ago
  28. a8d9a98 removed unnecessary retrying of inserts code from LSMHarness and ILSMIndexes; by zheilbron · 12 years ago
  29. 07e6bee made naming of ILSMIndexAccessor implementations consistent; by zheilbron · 12 years ago
  30. c544195 updated versions to 0.2.2-SNAPSHOT by zheilbron · 12 years ago
  31. d974a5b merged hyracks_asterix_stabilization -r1913:1947 to hyracks_lsm_tree by zheilbron · 12 years ago
  32. 949579a added IInMemoryFreePageManager & IInMemoryBufferCache interfaces by zheilbron · 12 years ago
  33. ca7f68d Removed unused package edu.uci.ics.hyracks.storage.am.common.lifecycle; by zheilbron · 12 years ago
  34. d8fc672 replaced the IIndexArtifactMap interface with the ILocalResourceRepository interface by kisskys · 12 years ago
  35. 09ff0db renamed IIndexOpContext and its methods for clarity by zheilbron · 12 years ago
  36. fba23a3 fixed bug in jaccard occurrence threshold computation to always return a positive (non-zero) value by zheilbron · 12 years ago
  37. a2789c4 fixed bug in index lifecycle: create() clears the in-memory state of an index instance as it should by zheilbron · 12 years ago
  38. 097aa7e More index operator cleanup for better code sharing with the lsm inverted index. by alexander.behm · 12 years ago
  39. 86000c3 set ignore properties by zheilbron · 12 years ago
  40. 0a335d6 More index operator cleanup. by alexander.behm · 12 years ago
  41. c25df01 First phase of cleaning up index operators for better code sharing. by alexander.behm · 12 years ago
  42. 0acc2d6 Switched inverted-index operators to lsm-inverted-index. Minor cleaning for better code sharing. by alexander.behm · 12 years ago
  43. 7660d93 Properly Using op callbacks in the lsm inverted index. by alexander.behm · 12 years ago
  44. 0e98fbe Adapted inverted index lifecycle calls to latest interfaces. by alexander.behm · 12 years ago
  45. dbdc0b4 Forgot a file. by alexander.behm · 12 years ago
  46. f8e7f24 Fixed incorrect sharing of inverted-list builder causing the multi-threaded tests to break. Finished multi-threading tests. by alexander.behm · 12 years ago
  47. f1b046a Fixed a few multi-threading issues in the lsm-inverted-index. Still some more to go. by alexander.behm · 12 years ago
  48. 512869d Checkpointing lsm-inverted-index multi thread test. Still needs some debugging. by alexander.behm · 12 years ago
  49. 53f8bc8 Added tests for gram-based indexes, and hashed tokens. by alexander.behm · 12 years ago
  50. 13401ad Improved and fixed a few bugs in the lsm inverted index tests. by alexander.behm · 12 years ago
  51. c809639 Another bugfix. by alexander.behm · 12 years ago
  52. a34f2c8 Small bugfix related to pinning/unpinning papes properly. by alexander.behm · 12 years ago
  53. 6740195 Fixed deletion protocol in the lsm-inverted-index. The in-memory deleted-keys BTree now only contains keys referring to on-disk components. Deletions that refer to documents in the in-memory inverted index are physically removed from there, and no entry to the deleted-keys BTree is made. This behavior seems necessary to avoid a pathological case of 'lost deletes' to on-disk components (more details in comments of the code). by alexander.behm · 12 years ago
  54. d07dfe0 Merged hyracks_lsm_tree r1846:r1858. by alexander.behm · 12 years ago
  55. 6632bec Dealing with deleted keys in search cursors. Tests to follow. by alexander.behm · 12 years ago
  56. a34fb9c Minor bugfix. by alexander.behm · 12 years ago
  57. 12c4a65 Significantly simplified LSMInvertedIndexSearchCursor in preparation to dealing with deletes. by alexander.behm · 12 years ago
  58. 1284f0c Minor cleanup for better code sharing. by alexander.behm · 12 years ago
  59. ac9a3c0 Added basic lsm-inverted-index delete test that validates the index using a range search cursor (sort-merges multiple components and removes deleted entries). Still need to remove deleted entries during regular inverted index searches. by alexander.behm · 12 years ago
  60. 456ee5d Added delete test for in-memory inverted index (only adding key to LSM buddy BTree can lead to false positives, practically impossible to test). Fixed a bug in the counting BTree cursor when dealing with empty pages due to deletes. by alexander.behm · 12 years ago
  61. 86d2866 First steps to getting delete working. by alexander.behm · 12 years ago
  62. 4d21c2c Implemented lsm-inverted-index merge. Added test. by alexander.behm · 12 years ago
  63. 17bbe81 Implemented lsm inverted index range search cursor that is used in merges. by alexander.behm · 12 years ago
  64. bdbe7ff Made changes to inverted index ops according to Zach's latest changes to index lifecycle management. by alexander.behm · 12 years ago
  65. e5d39b1 Added range search cursor for on-disk inverted index in preparation for implementing merge. by alexander.behm · 12 years ago
  66. 3023a59 Minor cleanup. by alexander.behm · 12 years ago
  67. 6053d6e Simplified a bunch of inverted-index interfaces. Added lsm inverted index search test. by alexander.behm · 12 years ago
  68. f25ad72 Added bulk loader for lsm inverted index and test (no multi-bulk-load test yet). by alexander.behm · 12 years ago
  69. 99cab5b Added lsm inverted index insert test based on new testing framework. by alexander.behm · 12 years ago
  70. a36ad67 Almost done with flush operation of lsm inverted index. by alexander.behm · 12 years ago
  71. ff8edcf Added component finalizer for lsm inverted index. Started to implement corresponding index file manager. by alexander.behm · 12 years ago
  72. c5bf2ef Started working on the lifecycle stuff for the LSM inverted index. by alexander.behm · 12 years ago
  73. 7daf2f4 Cleaned up more old tests. by alexander.behm · 12 years ago
  74. 78ebcd3 Added basic search test for in-memory inverted index based on new framework. Fixed a few bugs in the in-memory inverted list cursor. by alexander.behm · 12 years ago
  75. 5d7a0e1 Added first inverted-index search test based on new testing framework. Found and fixed a few bugs. by alexander.behm · 12 years ago
  76. 167b6ce Added validation of on-disk inverted index. Added bulk-load test for on-disk inverted index, and insert test for in-memory inverted index based on a new testing framework. by alexander.behm · 12 years ago
  77. 186b217 Added prefix-search capability for sorted sets of CheckTuples to enable comparing inverted indexes against a baseline inverted index. by alexander.behm · 12 years ago
  78. cb667d0 Started implementation of InvertedIndexTestContext. by alexander.behm · 12 years ago
  79. 0702b39 Moved files. by alexander.behm · 12 years ago
  80. 07f5206 More cleaning and reorg. by alexander.behm · 12 years ago
  81. 132c3b8 Next round of cleanup. by alexander.behm · 12 years ago
  82. 9d3eb62 More renaming and reorganizing. by alexander.behm · 12 years ago
  83. f4404a8 First round of renaming packages, and reorganizing files. by alexander.behm · 12 years ago
  84. 6a2bf49 Moved inverted index code into corresponding lsm projects. by alexander.behm · 12 years ago
  85. ef10d07 More cleaning and prepwork. by alexander.behm · 12 years ago
  86. b099505 Improved design and significantly reduced object creation of in-memory inverted index. by alexander.behm · 12 years ago
  87. 9f4b5f8 Reworked in-memory inverted index that buffers insertions. Still needs testing. by alexander.behm · 12 years ago
  88. 15c4e03 Second initial copy from hyracks_inverted_index_updates. by alexander.behm · 12 years ago