tree dd7668f9ea8b8341db018c02cfa3e5becc345add
parent d38122aa6546d7c1400516e41886814497712920
author Taewoo Kim <wangsaeu@gmail.com> 1410311621 -0700
committer Ian Maxon <imaxon@uci.edu> 1410380399 -0800

Implement TokenizeOperator in addition to the changes made by Zachary Heilbron.
Now, the compiler builds the bulk-load plan.
For other details, please refer to the corresponding Hyracks changes.

Change-Id: I646539d88ea2bdc6da4fbf2b6e9460a6189125ff
Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/79
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>
Reviewed-by: Young-Seok Kim <kisskys@gmail.com>