Sunspot Classification Using Tensor Flow on Bede - Part 1

Introduction

What is Bede?

Documentation

Installing Python Environment

Request interactive session

module load slurm
srun -A bdshe01 --pty bash

Unable to run the test model as tensor flow unable to detect a GPU. Solution is probably found in sharc documentation on tensorflow.

ML tools for space weather forecasting

Solution for Correct Installation and Configuration of Tensorflow on Bede

Needed to install annd build correct distribution of tensorflow for GPUs (inspired by clues here)

https://github.com/DurhamARC/bede/wiki#ibm-powerai-and-watson-machine-learning-community-edition-wmlce

cd /nobackup/projects/bdshe01/cs1mkg

 

wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-ppc64le.sh

sh Miniconda3-latest-Linux-ppc64le.sh



conda update conda

conda config --set channel_priority strict

conda config --prepend channels https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda/

conda create -n tensorflow-gpu python=3.6

conda activate tensorflow-gpu

conda install --strict-channel-priority tensorflow-gpu