modify scripts for creating the environment

README.md

@@ -20,7 +20,7 @@ Before running the application, make sure you have the following prerequisites i
 
 ## Getting Started
 
-1. Clone [this repository](https://code.hlrs.de/hpcrsaxe/spark_template) to your local machine:
+1. Clone this repository to your local machine:
 
 ```bash
 git clone <repository_url>
@@ -29,7 +29,8 @@ Before running the application, make sure you have the following prerequisites i
 2. Go into the directory and create an environment using Conda and environment.yaml. Note: Be sure to add the necessary packages in environment.yaml:
 
 ```bash
-   ./deployment_scripts/create-env.sh <your-env>
+cd deployment_scripts
+./create-env.sh <your-env>
 ```
 
 3. Send all files using `deploy-env.sh`:

deployment_scripts/create-env.sh

@@ -21,5 +21,5 @@ else
   # Create Conda environment
   conda env create --name $CONDA_ENV_NAME -f environment.yaml
 
-  echo "Conda environment '$CONDA_ENV_NAME' created."
+  conda clean --all --force-pkgs-dirs
 fi

deployment_scripts/environment.yaml

@@ -3,6 +3,7 @@ channels:
   - defaults
 dependencies:
   - python=3.10
+  - pip
   - pip:
     - ray==2.8.0
     - dask==2022.10.1