Gitiles
Code Review
Sign In
asterix-gerrit.ics.uci.edu
/
hyracks
/
d429aee16e539754e28019c4b6d47809434d82a4
/
genomix
/
genomix-driver
3274eac
try to have 2 local stes of CCs and NCs (-runLocal not working)
by Jake Biesinger
· 12 years ago
9e32331
Add full-pipeline counters
by Jake Biesinger
· 12 years ago
da9eeaf
hadoop uses |IO_DIRS| * #slaves reducers
by Jake Biesinger
· 12 years ago
a9f475d
use $IO_DIRS, not -coresPerMachine for hyracks partitions + hadoop #reducers
by Jake Biesinger
· 12 years ago
7294ef7
hadoop jar deployment fix
by Jake Biesinger
· 12 years ago
d21026a
shut down previous clusters again
by Jake Biesinger
· 12 years ago
2a30771
don't delete the default log directory on cluster shutdown
by Jake Biesinger
· 12 years ago
6f98c6f
read additional ports from .properties; launch multiple CC's on one machine(?)
by Jake Biesinger
· 12 years ago
a56a98a
read FRAME_SIZE and FRAME_LIMIT from cluster.properties
by Jake Biesinger
· 12 years ago
7f546b5
Use maven-built app.home when run from Eclipse (mus trun mvn package once)
by Jake Biesinger
· 12 years ago
3255cb1
move scripts back (can't run non-local eclipse without mvn package)
by Jake Biesinger
· 12 years ago
3fb78eb
move and chmod +x scripts in driver so eclipse can call the directly
by Jake Biesinger
· 12 years ago
2d358c6
runLocal is working but doesn't shut down properly
by Jake Biesinger
· 12 years ago
db95a42
only shut down pregelix cluster if it's running
by Jake Biesinger
· 12 years ago
0734cd2
STATS is a separate option and DUMP_FASTA can happen after any step
by Jake Biesinger
· 12 years ago
16a94ca
WIP: partial support for local/nonlocal for hadoop, hyracks and pregelix
by Jake Biesinger
· 12 years ago
eb807a3
add scratch dir creator script in driver
by Jake Biesinger
· 12 years ago
ee82213
increase default job history for adminconsole
by Jake Biesinger
· 12 years ago
ed5a065
less aggressive and adjustable cluster wait times
by Jake Biesinger
· 12 years ago
f389e7e
tweak framesize
by Jake Biesinger
· 12 years ago
eecb337
increase wait time and add a shutdown hook that stops the clusters
by Jake Biesinger
· 12 years ago
2d72d3e
add -followsGraphBuild for those inputs proceeding build
by Jake Biesinger
· 12 years ago
8f6b461
refactor pregelix job creation
by Anbang Xu
· 12 years ago
33d8284
fix driverUtils string value
by Anbang Xu
· 12 years ago
a32d7ce
adjust job history size
by Nan Zhang
· 12 years ago
6c4e526
read and set framesize from cluster.properties
by Jake Biesinger
· 12 years ago
15b6f47
add MAX_READ_IDS_PER_EDGE in opts parser and jobs
by Jake Biesinger
· 12 years ago
d169c54
auto-discover CC port and IP settings (broke runLocal)
by Jake Biesinger
· 12 years ago
843db89
Don't use infiniband ports (look into in the future)
by Jake Biesinger
· 12 years ago
21bb3d6
don't reuse Hyracks CC in Pregelix jobs
by Jake Biesinger
· 12 years ago
4aa155f
increase wait time and defer creating the driver until NCs are active
by Jake Biesinger
· 12 years ago
284e5f1
use .pid files to track the CC and NC nodes
by Jake Biesinger
· 12 years ago
3bb11f5
move start/stop cluster in utils
by Jake Biesinger
· 12 years ago
f18eed5
Add some logging and attempt to shut down servers on exception
by Jake Biesinger
· 12 years ago
5936fcb
fix NPE
by Jake Biesinger
· 12 years ago
ddeb021
Split driver utilities into their own file
by Jake Biesinger
· 12 years ago
e643029
genomix driver is responsible for start/stop of Hyracks/Pregelix clusters
by Jake Biesinger
· 12 years ago
dc32cf2
separate NC's for pregelix and hyracks
by Jake Biesinger
· 12 years ago
11823d7
simpler commands for script GENOMIX_HOME resolution
by Jake Biesinger
· 12 years ago
d4b581c
Run cluster and driver scripts from anywhere
by Jake Biesinger
· 12 years ago
558ea60
Merge aggregator with main branch
by Anbang Xu
· 12 years ago
50b28b6
Adpat hadoop testsuite to have linespermap arg
by Anbang Xu
· 12 years ago
4e63417
fix location of stores.properties
by Jake Biesinger
· 12 years ago
476760d
Add timed logging to genomix-driver jobs
by Jake Biesinger
· 12 years ago
0d0f899
use command-line args in genomix-driver
by Jake Biesinger
· 12 years ago
676a268
stats are binned by whole value
by Jake Biesinger
· 12 years ago
65ee367
add STATS and DUMP_FASTA steps to the graph (run locally)
by Jake Biesinger
· 12 years ago
5be5c46
fix coresPerMachine's default values
by Jake Biesinger
· 12 years ago
28cbeae
save intermediate results by default (found a bug in pregelix-core?)
by Jake Biesinger
· 12 years ago
8b79c57
don't save intermediate results by default; add option to do so
by Jake Biesinger
· 12 years ago
f9e6e5f
add hadoop building to the driver
by Jake Biesinger
· 12 years ago
630586c
add test case for synthetic data
by Jake Biesinger
· 12 years ago
d75565c
add option for corespermachine in jobconf
by Nan Zhang
· 12 years ago
21c3906
genomix-driver copies results to text
by Jake Biesinger
· 12 years ago
0d6afba
remove minidfs cluster (so writing directly to lcoal disk now)
by Jake Biesinger
· 12 years ago
34c19fd
refactoring local mode
by Jake Biesinger
· 12 years ago
2075152
add .tar.gz as an assembly target
by Jake Biesinger
· 12 years ago
a332dbe
copy conf directory into binary assembly output
by Jake Biesinger
· 12 years ago
4e22bc4
genomix driver takes a directory as local input
by Jake Biesinger
· 12 years ago
51a0502
separate genomix driver in/out to local/hdfs
by Jake Biesinger
· 12 years ago
34feeb2
add hyracks .properties and scripts to genomix-driver
by Jake Biesinger
· 12 years ago
1e8c661
driver pom generates cc and nc scripts
by Jake Biesinger
· 12 years ago
25a66b3
stop removing `expected` dir during clean (used for testing)
by Jake Biesinger
· 12 years ago
fad8c77
update genomix-driver pom to use auto-generated script
by Jake Biesinger
· 12 years ago
6aae1de
don't use root HDFS path
by Jake Biesinger
· 12 years ago
971c984
genomix driver actually uses cmdline args
by Jake Biesinger
· 12 years ago
b2d89d1
remove junit and pmcommon dependencies
by Jake Biesinger
· 12 years ago
3038537
appassembler for genomix driver
by Jake Biesinger
· 12 years ago
adac3ef
modify path for static test in driver
by Jake Biesinger
· 12 years ago
6c997b7
Fix kmer used in minicluster
by Jake Biesinger
· 12 years ago
c9fe0a9
driver adapts to build output (InitialGraphInputFormat)
by Jake Biesinger
· 12 years ago
1e86fe0
choose the unmerge_graphbuilding for genomix-driver
by Nan Zhang
· 12 years ago
fea8393
add unrollTandem to driver
by Jake Biesinger
· 12 years ago
bb9901e
re-remove nodes cleared out of Anbang's branch
by Jake Biesinger
· 12 years ago
5894562
GenomixDriver uses simpler pipeline builder
by Jake Biesinger
· 12 years ago
d4fa74b
Driver can run pregelix or Hyracks jobs locally
by Jake Biesinger
· 12 years ago
b1d8071
GenomixDriver: hryacks runs but can't find input
by Jake Biesinger
· 12 years ago
6eade1d
use local test cluster
by Jake Biesinger
· 12 years ago
639c806
separate config from driver and pipeline setup
by Jake Biesinger
· 12 years ago
11c499b
Add license header
by Jake Biesinger
· 12 years ago
1aad534
Update GenomixJobConf: must specify the kmerLength, extends JobConf
by Jake Biesinger
· 12 years ago
4f05864
Refactor configuration for all jobs into global GenomixJobConf
by Jake Biesinger
· 12 years ago