Gitiles
Code Review Sign In
asterix-gerrit.ics.uci.edu / asterixdb / 61a2442471fc74b995245e0722c68a688c344e4a / hyracks-storage-am-lsm-invertedindex
  1. 61a2442 added option to conditionally flush an LSM index when it is being deactivated; added missing file from previous commit by zheilbron · 12 years ago
  2. 874c474 added proper IO Opcallback for when LSM indexes are deactivatd by zheilbron · 12 years ago
  3. 4100d48 major reworking of all lsm indexes with respect to synchronization and interfacing with the lsmharness by zheilbron · 12 years ago
  4. c1fdccc minor cleanup: fixed typo; swapped sync objects for sync on 'this' by zheilbron · 12 years ago
  5. 5195427 getWrite/ReadDevices returns Set instead of List; by zheilbron · 12 years ago
  6. 2e6edf5 merged the creation and scheduling of flushes and merge IO operations to a single call by zheilbron · 12 years ago
  7. b652d52 removed flush controller; ILSMIndex replaces the functionality by zheilbron · 12 years ago
  8. 367564e Allowing LSM file managers to be initialized with a starting IO device index. Using that mechanism, the first disk component of the i-th partition of an Asterix LSM index is written on the i-th IO device (further components are assigned to IO devices in a round robin fashion). by alexander.behm · 12 years ago
  9. 20a817c * The cleanup of the merged components in the LSM indexes is now the responsibility of either: the last existing search thread (in case the merge process is over and there are still search threads accessing the merged components), or the merge thread itself (in case the merge process is over and there are no search threads accessing the merged components). * Allowed concurrent merges to occur at the same time instead of the old design which only allowed one merge process at a time per LSM index. by salsubaiee · 12 years ago
  10. 327341b Merged hyracks_asterix_stabilization r2462:r2562. by alexander.behm · 12 years ago
  11. 03b7f53 Refactored the LSM-indexes to use common abstract class. Added new ILSMComponent interface to represents the LSMComponents instead of passing Objects all around the place. Removed the component finalizers classes and cleaned the file manager API. Fixed couple of bugs. Cleaned the code and changed the names of many methods. by salsubaiee · 12 years ago
  12. d59755e Minor amendment to my multicomparator changes. by alexander.behm · 12 years ago
  13. da370f6 Finished implementing performance-optimized MultiComparators. by alexander.behm · 12 years ago
  14. e2e312b Added search modifiers that were moved from Asterix. by alexander.behm · 12 years ago
  15. 85011f4 Small beauty fixes. by alexander.behm · 12 years ago
  16. 8388fd8 Minor fix. by alexander.behm · 12 years ago
  17. 38c6578 Implemented dataflow components for length-partitioned inverted indexes. Added integration test. by alexander.behm · 12 years ago
  18. bbf3930 Changed partitioning field in length-partitioned inverted indexes from integer to short. by alexander.behm · 12 years ago
  19. 71ffa45 Changed the search algorithm for in-memory length-partitioned inverted indexes to only latch one inverted list at a time. by alexander.behm · 12 years ago
  20. 23055f7 Implemented length-partitioned LSM inverted index. Still some cleanup needed. by alexander.behm · 12 years ago
  21. 5161d80 Implemented in-memory component for length-partitioned inverted indexes. by alexander.behm · 12 years ago
  22. ff528ab Refactored code for better sharing. Added new test for on-disk component of length-partitioned inverted index. by alexander.behm · 12 years ago
  23. 0e13a7d Implemented bulk loading and basic search for the on-disk components of length-partitioned inverted indexes. by alexander.behm · 12 years ago
  24. b9ae24a Checkpointing progress on implementing a length-partitioned inverted index. by alexander.behm · 12 years ago
  25. 051c550 First steps in preparing the inverted-index testing framework to deal with length partitioning. by alexander.behm · 12 years ago
  26. 0b7985a Some generalizations to support length filtering. by alexander.behm · 12 years ago
  27. ded4ffe Fixed issue in LSM indexes where OS file handles would not be closed properly if destroy() was called after deactivate(). This issue caused 'too many open files' during the Asterix runtime tests on a 32-bit Ubuntu. by alexander.behm · 12 years ago
  28. 642df06 Added LSM insert/delete operator that uses 'try' operations and partial flushing of Hyracks frames to avoid deadlocks with LSM component flushes. by alexander.behm · 12 years ago
  29. e5a55aa Added 'try' versions of LSM index operations to allow their caller to avoid potential deadlocks involving LSM flushes. by alexander.behm · 12 years ago
  30. 3dc682dc Another round of interface changes for the operation tracker. by alexander.behm · 12 years ago
  31. f4827cf Changed operation tracker interface and implementations. by alexander.behm · 12 years ago
  32. f8775bb Split IOperationCallbackProvider into ISearchOperationCallbackFactory and IModificationOperationCallbackFactory since we are going to have a variety of implementations for them in Asterix. by alexander.behm · 12 years ago
  33. 568d40a Modified operation callback to include the after image in before(). by alexander.behm · 12 years ago
  34. a8d9a98 removed unnecessary retrying of inserts code from LSMHarness and ILSMIndexes; by zheilbron · 12 years ago
  35. 07e6bee made naming of ILSMIndexAccessor implementations consistent; by zheilbron · 12 years ago
  36. c544195 updated versions to 0.2.2-SNAPSHOT by zheilbron · 12 years ago
  37. d974a5b merged hyracks_asterix_stabilization -r1913:1947 to hyracks_lsm_tree by zheilbron · 12 years ago
  38. 949579a added IInMemoryFreePageManager & IInMemoryBufferCache interfaces by zheilbron · 12 years ago
  39. ca7f68d Removed unused package edu.uci.ics.hyracks.storage.am.common.lifecycle; by zheilbron · 12 years ago
  40. d8fc672 replaced the IIndexArtifactMap interface with the ILocalResourceRepository interface by kisskys · 12 years ago
  41. 09ff0db renamed IIndexOpContext and its methods for clarity by zheilbron · 12 years ago
  42. fba23a3 fixed bug in jaccard occurrence threshold computation to always return a positive (non-zero) value by zheilbron · 12 years ago
  43. a2789c4 fixed bug in index lifecycle: create() clears the in-memory state of an index instance as it should by zheilbron · 12 years ago
  44. 097aa7e More index operator cleanup for better code sharing with the lsm inverted index. by alexander.behm · 12 years ago
  45. 86000c3 set ignore properties by zheilbron · 12 years ago
  46. 0a335d6 More index operator cleanup. by alexander.behm · 12 years ago
  47. c25df01 First phase of cleaning up index operators for better code sharing. by alexander.behm · 12 years ago
  48. 0acc2d6 Switched inverted-index operators to lsm-inverted-index. Minor cleaning for better code sharing. by alexander.behm · 12 years ago
  49. 7660d93 Properly Using op callbacks in the lsm inverted index. by alexander.behm · 12 years ago
  50. 0e98fbe Adapted inverted index lifecycle calls to latest interfaces. by alexander.behm · 12 years ago
  51. dbdc0b4 Forgot a file. by alexander.behm · 12 years ago
  52. f8e7f24 Fixed incorrect sharing of inverted-list builder causing the multi-threaded tests to break. Finished multi-threading tests. by alexander.behm · 12 years ago
  53. f1b046a Fixed a few multi-threading issues in the lsm-inverted-index. Still some more to go. by alexander.behm · 12 years ago
  54. 512869d Checkpointing lsm-inverted-index multi thread test. Still needs some debugging. by alexander.behm · 12 years ago
  55. 53f8bc8 Added tests for gram-based indexes, and hashed tokens. by alexander.behm · 12 years ago
  56. 13401ad Improved and fixed a few bugs in the lsm inverted index tests. by alexander.behm · 12 years ago
  57. c809639 Another bugfix. by alexander.behm · 12 years ago
  58. a34f2c8 Small bugfix related to pinning/unpinning papes properly. by alexander.behm · 12 years ago
  59. 6740195 Fixed deletion protocol in the lsm-inverted-index. The in-memory deleted-keys BTree now only contains keys referring to on-disk components. Deletions that refer to documents in the in-memory inverted index are physically removed from there, and no entry to the deleted-keys BTree is made. This behavior seems necessary to avoid a pathological case of 'lost deletes' to on-disk components (more details in comments of the code). by alexander.behm · 12 years ago
  60. d07dfe0 Merged hyracks_lsm_tree r1846:r1858. by alexander.behm · 12 years ago
  61. 6632bec Dealing with deleted keys in search cursors. Tests to follow. by alexander.behm · 12 years ago
  62. a34fb9c Minor bugfix. by alexander.behm · 12 years ago
  63. 12c4a65 Significantly simplified LSMInvertedIndexSearchCursor in preparation to dealing with deletes. by alexander.behm · 12 years ago
  64. 1284f0c Minor cleanup for better code sharing. by alexander.behm · 12 years ago
  65. ac9a3c0 Added basic lsm-inverted-index delete test that validates the index using a range search cursor (sort-merges multiple components and removes deleted entries). Still need to remove deleted entries during regular inverted index searches. by alexander.behm · 12 years ago
  66. 456ee5d Added delete test for in-memory inverted index (only adding key to LSM buddy BTree can lead to false positives, practically impossible to test). Fixed a bug in the counting BTree cursor when dealing with empty pages due to deletes. by alexander.behm · 12 years ago
  67. 86d2866 First steps to getting delete working. by alexander.behm · 12 years ago
  68. 4d21c2c Implemented lsm-inverted-index merge. Added test. by alexander.behm · 12 years ago
  69. 17bbe81 Implemented lsm inverted index range search cursor that is used in merges. by alexander.behm · 12 years ago
  70. bdbe7ff Made changes to inverted index ops according to Zach's latest changes to index lifecycle management. by alexander.behm · 12 years ago
  71. e5d39b1 Added range search cursor for on-disk inverted index in preparation for implementing merge. by alexander.behm · 12 years ago
  72. 3023a59 Minor cleanup. by alexander.behm · 12 years ago
  73. 6053d6e Simplified a bunch of inverted-index interfaces. Added lsm inverted index search test. by alexander.behm · 12 years ago
  74. f25ad72 Added bulk loader for lsm inverted index and test (no multi-bulk-load test yet). by alexander.behm · 12 years ago
  75. 99cab5b Added lsm inverted index insert test based on new testing framework. by alexander.behm · 12 years ago
  76. a36ad67 Almost done with flush operation of lsm inverted index. by alexander.behm · 12 years ago
  77. ff8edcf Added component finalizer for lsm inverted index. Started to implement corresponding index file manager. by alexander.behm · 12 years ago
  78. c5bf2ef Started working on the lifecycle stuff for the LSM inverted index. by alexander.behm · 12 years ago
  79. 7daf2f4 Cleaned up more old tests. by alexander.behm · 12 years ago
  80. 78ebcd3 Added basic search test for in-memory inverted index based on new framework. Fixed a few bugs in the in-memory inverted list cursor. by alexander.behm · 12 years ago
  81. 5d7a0e1 Added first inverted-index search test based on new testing framework. Found and fixed a few bugs. by alexander.behm · 12 years ago
  82. 167b6ce Added validation of on-disk inverted index. Added bulk-load test for on-disk inverted index, and insert test for in-memory inverted index based on a new testing framework. by alexander.behm · 12 years ago
  83. 186b217 Added prefix-search capability for sorted sets of CheckTuples to enable comparing inverted indexes against a baseline inverted index. by alexander.behm · 12 years ago
  84. cb667d0 Started implementation of InvertedIndexTestContext. by alexander.behm · 12 years ago
  85. 0702b39 Moved files. by alexander.behm · 12 years ago
  86. 07f5206 More cleaning and reorg. by alexander.behm · 12 years ago
  87. 132c3b8 Next round of cleanup. by alexander.behm · 12 years ago
  88. 9d3eb62 More renaming and reorganizing. by alexander.behm · 12 years ago
  89. f4404a8 First round of renaming packages, and reorganizing files. by alexander.behm · 12 years ago
  90. 6a2bf49 Moved inverted index code into corresponding lsm projects. by alexander.behm · 12 years ago
  91. ef10d07 More cleaning and prepwork. by alexander.behm · 12 years ago
  92. b099505 Improved design and significantly reduced object creation of in-memory inverted index. by alexander.behm · 12 years ago
  93. 9f4b5f8 Reworked in-memory inverted index that buffers insertions. Still needs testing. by alexander.behm · 12 years ago
  94. 15c4e03 Second initial copy from hyracks_inverted_index_updates. by alexander.behm · 12 years ago