On main notebook interface I should remove Profile and add Batch button. Internally, I need another batch submission script to send CHAP to batch node. Follow CHESS batch page to see how to structure job submission.
We need the following steps:
- create tarball of given workflow, i.e. we'll need to copy all workflow files along with yaml configurations
- create another script for batch submission
- the
batch_submit.sh should call qsub command and copy necessary files to some area to unpack
- need to decide how to deal with
conda, therefore it may be I need to have proper conda environment in batch nodes or will need to create them dynamically
- should fetch job ID and provide link to
chap.log that user can find their batch job
On main notebook interface I should remove Profile and add Batch button. Internally, I need another batch submission script to send CHAP to batch node. Follow CHESS batch page to see how to structure job submission.
We need the following steps:
batch_submit.shshould call qsub command and copy necessary files to some area to unpackconda, therefore it may be I need to have proper conda environment in batch nodes or will need to create them dynamicallychap.logthat user can find their batch job