Questions tagged [platform-lsf]
Platform LSF is a job scheduler for high-performance computing environments
15 questions
0
votes
0
answers
48
views
bsub & tmux : does not always reconnect to same session
I have created a shortcut in my KDE environment that performs the following command :
bsub -q gui konsole -e tmux -Asmain
It creates a konsole and automatically open a tmux session named main .
The ...
- 101
1
vote
0
answers
1k
views
Parallel job submission of for loop
I have written for loop and parallelized it with & and limited the threshold to running 3 jobs at one time. Below is my script. I am reserving 32 cores and 256 GB memory through BSUB command. The ...
- 137
1
vote
1
answer
60
views
Tools for batching N commands over L scripts (for N≫L)?
Let's say that I have access to a high-performance Linux cluster equipped with a scheduler (e.g. LSF, Slurm, etc.) that will allow me to have up to M jobs either running or pending at any one time, of ...
- 16.4k
1
vote
1
answer
3k
views
What is "Platform LSF"?
Every day, I encounter at least one Wikipedia article about something computer-related, which should logically make sense to me if I've spent my entire life growing up with and dealing with computers ...
- 11
0
votes
1
answer
2k
views
Python script runs manually but not in cronjob
So this is a super weird issue. I have a python script that calls many bash commands via subprocess.call based on certain criteria. Now, the script runs just fine manually but when thrown into a ...
- 39
1
vote
1
answer
500
views
Live changing bjobs output
When using LSF command bjobs, I would like to get instantly changing output if I submit another job, because I feel stressful to run the same command again and again. I would like something like top ...
- 385
1
vote
1
answer
557
views
Getting wall time limit in bjobs
I'm writing a script that collect job information. I would like to get the wall time limit for each pending job (as specified with bsub -W) using bjobs. I can get information such as the number of ...
- 11
1
vote
1
answer
156
views
Is LSF queue allowed to preempt itself?
I have an LSF queue, say it's queue A. I only want higher priority jobs in queue A to preempt lower priority jobs in queue A, but not jobs in any other queues. If I set queue A to be preemptable, ...
- 11
1
vote
1
answer
509
views
Running lsf jobs in personal ubuntu pc
I have somewhat maybe little bit strange question running my jobs in my ubuntu laptop instead of running them hpc clusters.
The reason I want to to that is now I have 6 core 12 threads. I used to run ...
- 113
3
votes
3
answers
1k
views
Pipe (pass the output of previous command to the next command) with "|" when using "bsub"
Hi I guess this is a very basic question:
Is there any specific syntax to do the "piping" when using "bsub"?
I am asking that because when I had an issue like this:
# try to run the same command ...
- 541
2
votes
1
answer
516
views
How can a script tell if Platform LSF is available in an environment?
We have some shell scripts that presently utilize Platform LSF to manage job execution.
These scripts will eventually be migrated to an environment that uses a different job scheduler.
During the ...
- 11k
5
votes
2
answers
20k
views
lsf bkill all PEND jobs without killing RUN jobs
I'v lots bjobs running on lsf, jobs have two status, RUN and PEND. And I want to kill all bjobs with PEND status, how to do that use script? A hard-coded way I think is saving them in a file then ...
- 253
0
votes
1
answer
690
views
What's the correct job time limit specification for jobs to LSF
What is the correct way to specify how long a job can run on a computer cluster using LSF as the resource manager/ job scheduler?
LSF is a job scheduler that computing clusters use to allocate ...
- 103
1
vote
0
answers
214
views
how to make your tcsh command promt show LSF job count?
I want to monitor LSF job count through command prompt. %j will not give me the LSF job count. Can anyone tell how to configure command prompt to show the LSF job count?
- 71
6
votes
2
answers
10k
views
Pass argument to script, then redirect script as input to bsub
I am currently working with the bsub job submission system from Platform LSF. I need to submit job scripts, but I am running into a problem with passing arguments to the job script.
What I need is as ...
- 81