Improved tokenizer performance by reducing data copies.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_tokenizer_opt@946 eaa15691-b419-025a-1212-ee371bd00084
10 files changed