Gitiles
Code Review Sign In
asterix-gerrit.ics.uci.edu / asterixdb / 8fc8bf8b510bdc635f949f2eebf8b4d0d2a6b008
commit8fc8bf8b510bdc635f949f2eebf8b4d0d2a6b008[log] [tgz]
authorMurtadha Hubail <mhubail@uci.edu>Sat Jan 23 22:26:59 2016 -0800
committerMurtadha Hubail <hubailmor@gmail.com>Tue Jan 26 15:26:32 2016 -0800
treef42cc8f1df4cd00bbb7bf78daa4e699843f995d5
parent5b068d2d0dd210b0463efb639b3c7637db4842f9 [diff]
Asterix NCs Fault Tolerance

This change includes the following:
- Adapt replication to unique partitions storage.
- Implement auto failover for failing NCs.
- Implement auto failover for metadata node.
- Fix for ASTERIXDB-1251 using proper error message.
- Basic replication test cases using vagrant virtual cluster for:
   1. LSM bulkload components replication.
   2. LSM Memory components replication and recovery.
   3. Metadata node takeover.
These test cases will be part of the cluster test profile.

Change-Id: Ice26d980912a315fcb3efdd571d6ce88717cfea4
Reviewed-on: https://asterix-gerrit.ics.uci.edu/573
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Till Westmann <tillw@apache.org>
Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>
69 files changed
tree: f42cc8f1df4cd00bbb7bf78daa4e699843f995d5
  1. .gitattributes
  2. .gitignore
  3. DISCLAIMER
  4. LICENSE.txt
  5. NOTICE
  6. README.md
  7. asterix-algebra/
  8. asterix-app/
  9. asterix-benchmarks/
  10. asterix-common/
  11. asterix-doc/
  12. asterix-docker/
  13. asterix-events/
  14. asterix-examples/
  15. asterix-external-data/
  16. asterix-fuzzyjoin/
  17. asterix-installer/
  18. asterix-lang-aql/
  19. asterix-lang-common/
  20. asterix-lang-sqlpp/
  21. asterix-maven-plugins/
  22. asterix-metadata/
  23. asterix-om/
  24. asterix-replication/
  25. asterix-runtime/
  26. asterix-server/
  27. asterix-test-framework/
  28. asterix-tools/
  29. asterix-transactions/
  30. asterix-yarn/
  31. build.xml
  32. pom.xml
  33. src/
  34. tlp/
README.md

#AsterixDB

AsterixDB is a BDMS (Big Data Management System) with a rich feature set that sets it apart from other Big Data platforms. Its feature set makes it well-suited to modern needs such as web data warehousing and social data storage and analysis. AsterixDB has:

  • A semistructured NoSQL style data model (ADM) resulting from extending JSON with object database ideas
  • An expressive and declarative query language (AQL) that supports a broad range of queries and analysis over semistructured data
  • A parallel runtime query execution engine, Hyracks, that has been scale-tested on up to 1000+ cores and 500+ disks
  • Partitioned LSM-based data storage and indexing to support efficient ingestion and management of semistructured data
  • Support for query access to externally stored data (e.g., data in HDFS) as well as to data stored natively by AsterixDB
  • A rich set of primitive data types, including spatial and temporal data in addition to integer, floating point, and textual data
  • Secondary indexing options that include B+ trees, R trees, and inverted keyword (exact and fuzzy) index types
  • Support for fuzzy and spatial queries as well as for more traditional parametric queries
  • Basic transactional (concurrency and recovery) capabilities akin to those of a NoSQL store

Learn more about AsterixDB at [http://asterixdb.ics.uci.edu/] (http://asterixdb.ics.uci.edu/)

##Building AsterixDB

To build AsterixDB from source, you should have a platform with the following:

  • A Unix-ish environment (Linux, OS X, will all do).
  • git
  • Maven 3.1.1 or newer.
  • Java 7 or newer.

Additionally to run all the integration tests you should be running sshd locally, and have passwordless ssh logins enabled for the account which is running the tests.

##Documentation

AsterixDB's official documentation resides at [http://asterixdb.ics.uci.edu/documentation/index.html] (http://asterixdb.ics.uci.edu/documentation/index.html). This is built from the maven project under asterix-doc/ as a maven site. The documentation on the official website refers to the most stable release version, so for pre-release versions one should refer to the compiled documentation.

##Support/Contact

If you have any questions, please feel free to ask on our mailing list, users@asterixdb.incubator.apache.org. Join the list by sending an email to users-subscribe@asterixdb.incubator.apache.org. If you are interested in the internals or developement of AsterixDB, also please feel free to subscribe to our developer mailing list, dev@asterixdb.incubator.apache.org, by sending an email to dev-subscribe@asterixdb.incubator.apache.org.