SiVeGCS/dask_template
5
0
Fork 1
Code Issues 1 Pull requests Projects Releases Packages Wiki Activity

update the single node interactive mode according to the new conda workflow

Browse source
This commit is contained in:
Kerem Kayabay 2024-04-25 09:09:18 +02:00
parent ac99d53c62
commit 5a7702ec67
1 changed files with 12 additions and 19 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

31
README.md
View file

@ -43,28 +43,21 @@ Using a single node interactively provides opportunities for faster code debuggi
qsub -I -l select=1:node_type=rome -l walltime=01:00:00 qsub -I -l select=1:node_type=rome -l walltime=01:00:00
``` ```
**Step 2.** Go into the project directory: **Step 2.** Activate the Conda environment:
```bash ```bash
cd <project_directory>/deployment_scripts # Load the Conda module
module load bigdata/conda
source activate # activates the base environment
# List available Conda environments for verification purposes
conda env list
# Activate a specific Conda environment.
conda activate ray_environment # you need to execute `source activate` first, or use `source [ENV_PATH]/bin/activate`
``` ```
**Step 3.** Deploy the conda environment to the ram disk: **Step 3.** Initialize the Ray cluster.
Change the following line by editing `deploy-env.sh`:
```bash
export WS_DIR=<workspace_dir>
```
Then, use the following command to deploy and activate the environment:
```bash
source deploy-env.sh
```
Note: Make sure all permissions are set using `chmod +x`.
**Step 4.** Initialize the Ray cluster.
You can use a Python interpreter to start a local Ray cluster: You can use a Python interpreter to start a local Ray cluster:
@ -74,7 +67,7 @@ import ray
ray.init() ray.init()
``` ```
**Step 5.** Connect to the dashboard. **Step 4.** Connect to the dashboard.
Warning: Do not change the default dashboard host `127.0.0.1` to keep Ray cluster reachable by only you. Warning: Do not change the default dashboard host `127.0.0.1` to keep Ray cluster reachable by only you.