Week 10 Exercises - First Steps on Talapas

Short, ungraded practice tasks - about 40 minutes, all on Talapas. Companion reading: Ch. 20 and Ch. 21; reference: App. I. You need your Talapas account working (the account check at the end of Ex 7) - if it is not, that is task 0: contact me. HW2 is due today; these tasks are the cluster leg of your term project.

  1. Log in to Open OnDemand at https://ondemand.talapas.uoregon.edu with your Duck ID and open the file explorer. What is the path of your home directory?
  2. Open a shell from OnDemand (or ssh yourduckid@login.talapas.uoregon.edu) and run hostname and pwd.
  3. Run groups - which PIRG(s) are you in?
  4. Recreate your course skeleton on the cluster: mkdir -p ~/comptools/{data,scripts,results}.
  5. Transfer Stickle_RNAseq.tsv to ~/comptools/data (OnDemand’s file explorer upload button, or scp from your laptop). Confirm with wc -l.
  6. Run module avail R (press q to exit the list), then module load an R version and start R on the login node just long enough to run R.version.string and quit.
  7. Write a minimal Slurm script scripts/hello.sbatch that just prints hostname and date: start from the batch-script template in the book (Ch. 20), keep the --job-name, --partition, --account and --time lines, and drop the rest (including --output, so task 8’s log gets the default slurm-*.out name).
  8. Submit it with sbatch scripts/hello.sbatch, watch the queue with squeue -u $USER, and when it finishes, cat the slurm-*.out file. Which node did it run on?
  9. Run sinfo and identify one regular partition and the GPU partition.
  10. From the shell, run your Week 3 grep pipeline on the dataset - identical commands, bigger computer. That is the point of the shell.
  11. Bring your own software: git clone your project repository onto the cluster (that is why it lives on GitHub), or transfer the environment.yml you exported in Week 9. Then module spider miniconda, module load it, and conda env create -f environment.yml.
  12. conda activate rnaseq and check which python3 - the same environment as your laptop, built from one text file. Then prove it travels into batch jobs: edit scripts/hello.sbatch to module load miniconda, conda activate rnaseq, and run python3 -c "import pandas as pd; print(pd.__version__)", and resubmit. The pandas version in the log is your environment running on a compute node - the full loop, closed.