cctools

makeflow: get work_queue_auto_remove_workers_on from environment

pbui — Wed, 25 Apr 2012 23:37:01 +0100

Rev 1996 - pbui (1 file(s) modified)

makeflow: get work_queue_auto_remove_workers_on from environment

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

makeflow: get WorkQueue master mode and name from environment

pbui — Wed, 25 Apr 2012 23:12:45 +0100

Rev 1995 - pbui (1 file(s) modified)

makeflow: get WorkQueue master mode and name from environment

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

Merge from trunk r1989:r1993

pbui — Wed, 25 Apr 2012 21:04:25 +0100

Rev 1994 - pbui (4 file(s) modified)

Merge from trunk r1989:r1993

~ /branches/pbui/makeflow-dissertation/doc/man/parrot_run.m4
~ /branches/pbui/makeflow-dissertation/dttools/src/ec2_remove_workers
~ /branches/pbui/makeflow-dissertation/parrot/src/irods_reli.c
~ /branches/pbui/makeflow-dissertation/parrot/src/pfs_main.cc

makeflow: include length of wrapper when we malloc

pbui — Wed, 25 Apr 2012 20:53:13 +0100

Rev 1992 - pbui (1 file(s) modified)

makeflow: include length of wrapper when we malloc

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

makeflow: get batch queue type from environment variable

pbui — Wed, 25 Apr 2012 19:42:17 +0100

Rev 1990 - pbui (1 file(s) modified)

makeflow: get batch queue type from environment variable

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

makeflow: fix off-by-one on string buffer

pbui — Wed, 25 Apr 2012 01:24:52 +0100

Rev 1989 - pbui (1 file(s) modified)

makeflow: fix off-by-one on string buffer

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

Merge from trunk r1977:r1987

pbui — Tue, 24 Apr 2012 17:09:22 +0100

Rev 1988 - pbui (1 file(s) modified)

Merge from trunk r1977:r1987

~ /branches/pbui/makeflow-dissertation/dttools/src/work_queue.c

makeflow: cleanup dag_width, smart local subnests, clean up dag_check_dependencies 1. Clean ...

pbui — Tue, 24 Apr 2012 17:05:09 +0100

Rev 1987 - pbui (1 file(s) modified)

makeflow: cleanup dag_width, smart local subnests, clean up dag_check_dependencies

1. Clean up Kevin's dag_width a bit

2. Use dag_width to compute maximum number of concurrent nests; with this
information we can set subnests to use a proportional amount of CORES, rather
than all of them.

3. Break out GC stuff into separate function for clarity.

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

makeflow: avoid rerunning nodes if missing files were garbage collected Now ...

pbui — Tue, 24 Apr 2012 04:56:15 +0100

Rev 1986 - pbui (1 file(s) modified)

makeflow: avoid rerunning nodes if missing files were garbage collected

Now when we schedule a node to be re-run, we have check to see if any of our
parents generated inputs that were garbage collected and rerun them to ensure
our task has the necessary inputs.

Also add a minor check to see if a file exists before unlinking it. This
suppresses an unnecessary warning.

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

dttools: remove debug statement

pbui — Mon, 23 Apr 2012 05:24:03 +0100

Rev 1984 - pbui (1 file(s) modified)

dttools: remove debug statement

~ /branches/pbui/makeflow-dissertation/dttools/src/text_list.c

allpairs: make sure allpairs gets rebuilt when dttools is updated

pbui — Sun, 22 Apr 2012 20:34:59 +0100

Rev 1983 - pbui (1 file(s) modified)

allpairs: make sure allpairs gets rebuilt when dttools is updated

~ /branches/pbui/makeflow-dissertation/allpairs/src/Makefile

dttools: use string_chomp in text_list_load Fix bug where last character in ...

pbui — Sun, 22 Apr 2012 20:34:30 +0100

Rev 1982 - pbui (1 file(s) modified)

dttools: use string_chomp in text_list_load

Fix bug where last character in text file was truncated. This occurs if the
file does not have a final newline.

~ /branches/pbui/makeflow-dissertation/dttools/src/text_list.c

makeflow: decrement barrier before checking

pbui — Sun, 22 Apr 2012 17:10:19 +0100

Rev 1981 - pbui (1 file(s) modified)

makeflow: decrement barrier before checking

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

makeflow: ensure the barrier is set to at least 1

pbui — Sun, 22 Apr 2012 17:09:15 +0100

Rev 1980 - pbui (1 file(s) modified)

makeflow: ensure the barrier is set to at least 1

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

makeflow: only try to garbage collection every 5% of the ...

pbui — Sun, 22 Apr 2012 16:53:34 +0100

Rev 1979 - pbui (1 file(s) modified)

makeflow: only try to garbage collection every 5% of the tasks

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

makeflow: make ref_count log message match other gc methods

pbui — Sat, 21 Apr 2012 23:07:31 +0100

Rev 1978 - pbui (1 file(s) modified)

makeflow: make ref_count log message match other gc methods

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

makeflow: record garbage collection information for testing Record timestamp, # of ...

pbui — Sat, 21 Apr 2012 21:39:02 +0100

Rev 1977 - pbui (1 file(s) modified)

makeflow: record garbage collection information for testing

Record timestamp, # of files collected, amount of time spent collecting, and total number of files collected

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

Merge from trunk r1970:r1975

pbui — Fri, 20 Apr 2012 17:13:28 +0100

Rev 1976 - pbui (4 file(s) modified)

Merge from trunk r1970:r1975

~ /branches/pbui/makeflow-dissertation/dttools/src/work_queue_pool.c
~ /branches/pbui/makeflow-dissertation/dttools/src/work_queue_worker.c
~ /branches/pbui/makeflow-dissertation/parrot/src/pfs_dispatch.cc
~ /branches/pbui/makeflow-dissertation/parrot/src/pfs_dispatch64.cc

makeflow: don't GC if we have failed

pbui — Fri, 20 Apr 2012 02:49:38 +0100

Rev 1969 - pbui (1 file(s) modified)

makeflow: don't GC if we have failed

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c

Revert r1967

pbui — Fri, 20 Apr 2012 02:49:04 +0100

Rev 1968 - pbui (1 file(s) modified)

Revert r1967

~ /branches/pbui/makeflow-dissertation/makeflow/src/makeflow.c