or
work_queue_pool [options] -a <num-workers>
If the <hostname> and <port> arguments are provided, the workers maintained by the work_queue_pool process would only work for the master running at <hostname>:<port>. If the -a option is present, then the <hostname> and <port> arguments are not needed and the workers would contact a catalog server to find out the appropriate masters (see the -N option). In either case, the <number> argument specifies the number of workers that work_queue_pool should maintain.
If a work_queue_worker process managed by the work_queue_pool is shutdown (i.e. failure, eviction, etc.), then the work_queue_pool will re-submit a new work_queue_worker to the specified batch system <type> in order to maintain a constant <number> of work_queue_worker processes.
-d <subsystem> | |
Enable debugging for this subsystem. | |
-S <scratch> | |
Scratch directory. (default is /tmp/${USER}-workers) | |
-T <type> | |
Batch system type: unix, condor, sge, workqueue, xgrid. (default is unix) | |
-r <count> | |
Number of attemps to retry if failed to submit a worker. | |
-W <path> | |
Path to the work_queue_worker(1) executable. | |
-h | Show this screen. |
-a | Enable auto mode. In this mode the workers would ask a catalog server for available masters. |
-t <time> | |
Abort after this amount of idle time. | |
-C <catalog> | |
Set catalog server to <catalog>. Format: HOSTNAME:PORT | |
-N <project> | |
Name of a preferred project. A worker can have multiple preferred projects. | |
-s | Run as a shared worker. By default the workers would only work for preferred projects. |
-o <file> | |
Send debugging to this file. |
work_queue_pool -T condor barney.nd.edu 9123 10If you want to start the 10 workers on the SGE batch system instead, you only need to change the -T option:
work_queue_pool -T sge barney.nd.edu 9123 10If you have access to both of the Condor and SGE systems, you can run both of the above commands and you will then get 20 workers for your master.
makeflow -T wq -a -N myproject makeflow.scriptThe -N option given to makeflow specifies the project name for the Work Queue master. The master's information, such as hostname and port, will be reported to a catalog server. The work_queue_pool program can start workers that prefer to work for this master by specifying the same project name on the command line (see the -N option):
work_queue_pool -T condor -N my_project -a 10