Task Runner (Batch Job Scheduler)

(all-tasks tasker &opt detailed)

Get an array of all task ids for which there is still data on disk. If detailed is truthy, return full task metadata instead of ids.

(cancel-task tasker task-id)

Cancel a queued or running task.

(close-queues tasker)

Prevent any tasks from being added to queues. When an executor finishes its current job, if there are any, it will terminate. When all executors complete, the call to run-executors will complete.

Default expiration time (1 day)

Default task priority

Default location of task records

Name of the file for logging errors

Maximum allowed priority (lower priority tasks will execute first)

Minimum allowed priority (lower priority tasks will execute first)

(new-tasker &opt task-directory queues queue-size)

Create queues and various settings to run tasks. Create a new tasker table.

Name of the file for general logging

(queue-task tasker argv &opt note priority qname timeout expiration input)

Add a task specification to a queue. Supply an argv string array that will be used to invoke a subprocess. The optional note parameter is just a textual note for task tracking. The priority parameter should be an integer between 0 and 9 inclusive, default is 4. Lower priority jobs in the same queue will be executed by higher priority. Use input to pass in generic, unstructured input to a task.

(run-cleanup tasker)

Delete old expired jobs saved on disk

(run-executors tasker &opt workers-per-queue pre-task post-task)

Start a number of executors to run tasks as with tasker/spawn-executors, and then wait for all executors to complete.

(spawn-executors tasker &opt qnames workers-per-queue pre-task post-task)

Start a number of executors to run tasks. Tasks can be added to a queue by calling queue-task. A single tasker object can make multiple calls to spawn-executors.

A tuple of all possible statuses that a task can have.

(task-file tasker task-id &opt file-name)

Get a log file for a path. By default, will get a path to out.log.

Name of the task metadata file

(task-status tasker task-id)

Look up the status of a given task by id.