Cooley (ALCF)
Contents
Cooley (ALCF)#
Warning
This page is outdated and refers to last known installation procedures for Cooley.
Cooley is a GPU cluster at Argonne Leadership Computing Facility (ALCF). It has a total of 126 compute nodes; each node has 12 CPU cores and one NVIDIA Tesla K80 dual-GPU card.
User installation#
Before installating DeepHyper, go to your project folder:
cd /lus/theta-fs0/projects/PROJECTNAME
mkdir cooley && cd cooley/
DeepHyper can be installed on Cooley by following these commands:
git clone https://github.com/deephyper/deephyper.git --depth 1
./deephyper/install/cooley.sh
Then, restart your session.
Warning
You will note that a new file ~/.bashrc_cooley
was created and sourced in the ~/.bashrc
. This is to avoid conflicting installations between the different systems available at the ALCF.
Note
To test you installation run:
./deephyper/tests/system/test_cooley.sh
A manual installation can also be performed with the following set of commands:
# Install Miniconda
wget https://repo.anaconda.com/miniconda/Miniconda3-py39_4.9.2-Linux-x86_64.sh -O miniconda.sh
bash $PWD/miniconda.sh -b -p $PWD/miniconda
rm -f miniconda.sh
# Install Postgresql
wget http://get.enterprisedb.com/postgresql/postgresql-9.6.13-4-linux-x64-binaries.tar.gz -O postgresql.tar.gz
tar -xf postgresql.tar.gz
rm -f postgresql.tar.gz
# adding Cuda
echo "+cuda-10.2" >> ~/.soft.cooley
resoft
source $PWD/miniconda/bin/activate
# Create conda env for DeepHyper
conda create -p dh-cooley python=3.8 -y
conda activate dh-cooley/
conda install gxx_linux-64 gcc_linux-64 -y
# DeepHyper + Analytics Tools (Parsing logs, Plots, Notebooks)
pip install deephyper[analytics,balsam]
conda install tensorflow-gpu
Warning
The same .bashrc
is used both on Theta and Cooley. Hence adding a module load
instruction to the .bashrc
will not work on Cooley. In order to solve this issue you can add a specific statement to your .bashrc
file and create separate bashrc files for Theta and Cooley and use them as follows.
# Theta Specific
if [[ $HOSTNAME = *"theta"* ]];
then
source ~/.bashrc_theta
# Cooley Specific
else
source ~/.bashrc_cooley
fi