Added document generator for creating random documents (driven by a dictionary file) whose tokens are zipf distributed. This will be the basis for a unified inverted-index testing framework.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_inverted_index_updates_new@1816 123451ca-8445-de46-9d55-352943316053
25 files changed