We are thinking of screening the 1.4B Enamine library on one of our targets. In that effort, we are trying to set up the cluster on AWS cluster.
The cluster we have set up is of this:
- Head node: m5.2xLarge 8vCPUS 32Gb (has 8 cores)
- Compute node: c5.24xlarge 96 vCPUS 200GB Memory (has 96 cores)
- Job scheduler installed: SLURM
The number of compute nodes can be increased. So, how would one set many of the parameters in the all.ctrl files with the above configuration in mind. Here are the parameters that I am not able to understand, and I would appreciate if you could give some clarity. This is the first time I am setting up a cluster and using it on this scale.
- partition=test ( I first got an error say partition name test couldn’t be found; After googling, I used sinfo and found that under PARTITION was compute*. So, I changed it to compute
- cpus_per_queue = 1
How to set these parameters ( as an example using the configuration of cluster we have here)
I also tried to run the tutorial from scratch and ran into problems.The specific error I am getting is
sbatch: error: Memory specification can not be satisfied
sbatch: error: Batch job submission failed: Requested node configuration is not available
Hope to hear from you as to how to deal with these things.