University of Hamburg - to research, to teach, to educate and form, to homepage
RRZ
Regional Computing Center
(RRZ)

Photo: Thomas Orgis

jobber examples: output options

jobber has I/O options that are similar to other programs that launch parallel processes (like mpirun or srun):

  • --label: label task output with "task_id:".
  • --label=2: label task output with "task_id.worker_id:".
  • --msgprefix: label jobber output with an own prefix.
  • ++timestamp: do not print timestamps in jobber output.
  • --iodir: generate output per task in the specified directory, files are named task_id.worker_id.out, task_id.worker_id.err, and, if needed, task_id.in.

--label

shell$ cat task.list
sleep 1; echo '### this is task 1 ###'
sleep 1; echo '### this is task 2 ###'
sleep 1; echo '### this is task 3 ###'
sleep 1; echo '### this is task 4 ###'
sleep 1; echo '### this is task 5 ###'
shell$ jobber task.list init
[2022-04-05T09:38:48] appended 5 tasks
shell$ jobber --label task.list 3
[2022-04-05T09:38:48] 1.1 task.worker: sleep 1; echo '### this is task 1 ###'
[2022-04-05T09:38:49] 1.1 exit status: 0
1: ### this is task 1 ###
[2022-04-05T09:38:49] 2.2 task.worker: sleep 1; echo '### this is task 2 ###'
[2022-04-05T09:38:50] 2.2 exit status: 0
2: ### this is task 2 ###
[2022-04-05T09:38:50] 3.3 task.worker: sleep 1; echo '### this is task 3 ###'
[2022-04-05T09:38:51] 3.3 exit status: 0
3: ### this is task 3 ###
shell$

--label=2

shell$ cat task.list
sleep 1; echo '### this is task 1 ###'
sleep 1; echo '### this is task 2 ###'
sleep 1; echo '### this is task 3 ###'
sleep 1; echo '### this is task 4 ###'
sleep 1; echo '### this is task 5 ###'
shell$ jobber task.list init
[2022-04-05T09:39:32] appended 5 tasks
shell$ jobber --label=2 task.list 3
[2022-04-05T09:39:32] 1.1 task.worker: sleep 1; echo '### this is task 1 ###'
[2022-04-05T09:39:33] 1.1 exit status: 0
1.1: ### this is task 1 ###
[2022-04-05T09:39:33] 2.2 task.worker: sleep 1; echo '### this is task 2 ###'
[2022-04-05T09:39:34] 2.2 exit status: 0
2.2: ### this is task 2 ###
[2022-04-05T09:39:34] 3.3 task.worker: sleep 1; echo '### this is task 3 ###'
[2022-04-05T09:39:35] 3.3 exit status: 0
3.3: ### this is task 3 ###
shell$

--msgprefix

shell$ cat task.list
sleep 1; echo '### this is task 1 ###'
sleep 1; echo '### this is task 2 ###'
sleep 1; echo '### this is task 3 ###'
sleep 1; echo '### this is task 4 ###'
sleep 1; echo '### this is task 5 ###'
shell$ jobber task.list init
[2022-04-05T09:40:08] appended 5 tasks
shell$ jobber --msgprefix='ownPrefix: ' task.list 3
ownPrefix: [2022-04-05T09:40:08] 1.1 task.worker: sleep 1; echo '### this is task 1 ###'
### this is task 1 ###
ownPrefix: [2022-04-05T09:40:09] 1.1 exit status: 0
ownPrefix: [2022-04-05T09:40:09] 2.2 task.worker: sleep 1; echo '### this is task 2 ###'
### this is task 2 ###
ownPrefix: [2022-04-05T09:40:10] 2.2 exit status: 0
ownPrefix: [2022-04-05T09:40:10] 3.3 task.worker: sleep 1; echo '### this is task 3 ###'
### this is task 3 ###
ownPrefix: [2022-04-05T09:40:11] 3.3 exit status: 0
shell$

++timestamp

shell$ cat task.list
sleep 1; echo '### this is task 1 ###'
sleep 1; echo '### this is task 2 ###'
sleep 1; echo '### this is task 3 ###'
sleep 1; echo '### this is task 4 ###'
sleep 1; echo '### this is task 5 ###'
shell$ jobber task.list init
[2022-04-05T09:40:34] appended 5 tasks
shell$ jobber ++timestamp task.list 3
1.1 task.worker: sleep 1; echo '### this is task 1 ###'
### this is task 1 ###
1.1 exit status: 0
2.2 task.worker: sleep 1; echo '### this is task 2 ###'
### this is task 2 ###
2.2 exit status: 0
3.3 task.worker: sleep 1; echo '### this is task 3 ###'
### this is task 3 ###
3.3 exit status: 0
shell$

--iodir

shell$ cat task.list
sleep 1; echo '### this is task 1 ###'
sleep 1; echo '### this is task 2 ###'
sleep 1; echo '### this is task 3 ###'
sleep 1; echo '### this is task 4 ###'
sleep 1; echo '### this is task 5 ###'
shell$ jobber task.list init
[2022-04-05T09:41:06] appended 5 tasks
shell$ jobber --iodir=IOdir task.list 3
[2022-04-05T09:41:06] 1.1 task.worker: sleep 1; echo '### this is task 1 ###'
[2022-04-05T09:41:07] 1.1 exit status: 0
[2022-04-05T09:41:07] 2.2 task.worker: sleep 1; echo '### this is task 2 ###'
[2022-04-05T09:41:08] 2.2 exit status: 0
[2022-04-05T09:41:08] 3.3 task.worker: sleep 1; echo '### this is task 3 ###'
[2022-04-05T09:41:09] 3.3 exit status: 0
grep . IOdir/*
IOdir/1.1.out:### this is task 1 ###
IOdir/2.2.out:### this is task 2 ###
IOdir/3.3.out:### this is task 3 ###
shell$