Gitiles
Code Review Sign In
asterix-gerrit.ics.uci.edu / asterixdb / f674168dfde9c05700ea3b68e0b95594797d682b
commitf674168dfde9c05700ea3b68e0b95594797d682b[log] [tgz]
authorXikui Wang <xkkwww@gmail.com>Thu Feb 22 19:17:17 2018 -0800
committerXikui Wang <xkkwww@gmail.com>Fri Feb 23 10:40:40 2018 -0800
treec548c27da6f205de15ad211c97debccf33e1ac3a
parent172ce0b89b896967ed69024f0c9f9ea6ec1df62f [diff]
[ASTERIXDB-2227][ING] Enabling filitering incoming data in feed

- user model changes: yes
  Add syntax support for specifying predicate in connect feed
- storage format changes: no
- interface changes: no

Details:
In some use cases, a user may want to filter the incombing data with
certain attributes. One example can be only store the incoming tweets
with geo locations. This patch enables the <WHERE> clause in connect
feed statement. User can subset the incoming data using following
syntax:

 connect feed feeds.TweetFeed to  dataset Tweets3 using policy `Basic`
 WHERE id NOT LIKE 'nc1:10%' OR username = 'BronsonMike';

Change-Id: I0b3cc6fe9d7fb5f5645dd9c759da448bfe1e88f1
Reviewed-on: https://asterix-gerrit.ics.uci.edu/2255
Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>
14 files changed
tree: c548c27da6f205de15ad211c97debccf33e1ac3a
  1. .gitattributes
  2. .gitignore
  3. README.md
  4. asterixdb/
  5. build.xml
  6. hyracks-fullstack/
  7. pom.xml
README.md

What is AsterixDB?

AsterixDB is a BDMS (Big Data Management System) with a rich feature set that sets it apart from other Big Data platforms. Its feature set makes it well-suited to modern needs such as web data warehousing and social data storage and analysis. AsterixDB has:

  • Data model
    A semistructured NoSQL style data model (ADM) resulting from extending JSON with object database ideas

  • Query languages
    Two expressive and declarative query languages (SQL++ and AQL) that support a broad range of queries and analysis over semistructured data

  • Scalability
    A parallel runtime query execution engine, Apache Hyracks, that has been scale-tested on up to 1000+ cores and 500+ disks

  • Native storage
    Partitioned LSM-based data storage and indexing to support efficient ingestion and management of semistructured data

  • External storage
    Support for query access to externally stored data (e.g., data in HDFS) as well as to data stored natively by AsterixDB

  • Data types
    A rich set of primitive data types, including spatial and temporal data in addition to integer, floating point, and textual data

  • Indexing
    Secondary indexing options that include B+ trees, R trees, and inverted keyword (exact and fuzzy) index types

  • Transactions
    Basic transactional (concurrency and recovery) capabilities akin to those of a NoSQL store

Learn more about AsterixDB at its website.

Build from source

To build AsterixDB from source, you should have a platform with the following:

  • A Unix-ish environment (Linux, OS X, will all do).
  • git
  • Maven 3.3.9 or newer.
  • Oracle JDK 8 or newer.

Instructions for building the master:

  • Checkout AsterixDB master:

      $git clone https://github.com/apache/asterixdb.git

  • Build AsterixDB master:

      $cd asterixdb
  $mvn clean package -DskipTests

Run the build on your machine

Here are steps to get AsterixDB running on your local machine:

  • Start a single-machine AsterixDB instance:

      $cd asterixdb/asterix-server/target/asterix-server-*-binary-assembly/
  $./opt/local/bin/start-sample-cluster.sh

  • Good to go and run queries in your browser at:

      http://localhost:19001

  • Read more documentations to learn the data model, query language, and how to create a cluster instance.

Documentation

Community support