tree 8590850ca93c9c32c0addf21997a21a3afef3bbb
parent c9a3a9be189846a5c3b476d57c2576355589465d
author Taewoo Kim <wangsaeu@yahoo.com> 1439329861 -0700
committer Taewoo Kim <wangsaeu@gmail.com> 1439348296 -0700

Optimized the binary tokenizer - get the total number of tokens
Change-Id: I83765b6cd7cb92648aa55b260b0044fa3ffdcd7d
Reviewed-on: https://asterix-gerrit.ics.uci.edu/349
Reviewed-by: Young-Seok Kim <kisskys@gmail.com>
Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>