2021-08-03 14:53:40 +00:00
|
|
|
name: Bootstrapping
|
|
|
|
|
|
|
|
on:
|
2021-11-09 11:02:24 +00:00
|
|
|
# This Workflow can be triggered manually
|
|
|
|
workflow_dispatch:
|
Reorder workflow execution in GHA (#32183)
This patchset refactors our GitHub actions into a single top-level ci workflow that
invokes a series of reusable actions. The main goal of this is to be able to easily
control which tests run and in what order based on the success or failure of top-level
prechecks. Our previous workflows ran in three sets:
* nix tests: style and verification first, then linux and macos tests if successful
* windows tests: style and verification first, then linux and macos tests if successful
* bootstrap tests
As a result, the bootstrap tests ran even if the style failed, and style and verification
had to run on two different platforms despite running identical checks. I'm relatively
sure that's because of the limitation on dependencies between steps in the jobs.
Reusable workflows allow us to run the style, verification and now audit checks once,
then depending on the results, and the files changed, run the appropriate nix, windows
and bootstrap tests. While it saves only a few minutes by itself, this makes it easier to
refactor checks to subset tests without having to replicate tests or other workflow
components in the future.
Co-authored-by: Massimiliano Culpo <massimiliano.culpo@gmail.com>
2022-09-02 21:09:23 +00:00
|
|
|
workflow_call:
|
2021-08-03 14:53:40 +00:00
|
|
|
schedule:
|
|
|
|
# nightly at 2:16 AM
|
|
|
|
- cron: '16 2 * * *'
|
|
|
|
|
2022-06-08 22:46:46 +00:00
|
|
|
concurrency:
|
2022-09-07 18:12:57 +00:00
|
|
|
group: bootstrap-${{github.ref}}-${{github.event.pull_request.number || github.run_number}}
|
2022-06-08 22:46:46 +00:00
|
|
|
cancel-in-progress: true
|
|
|
|
|
2021-08-03 14:53:40 +00:00
|
|
|
jobs:
|
2024-05-07 06:49:53 +00:00
|
|
|
distros-clingo-sources:
|
2021-08-03 14:53:40 +00:00
|
|
|
runs-on: ubuntu-latest
|
2024-05-07 06:49:53 +00:00
|
|
|
container: ${{ matrix.image }}
|
|
|
|
strategy:
|
|
|
|
matrix:
|
|
|
|
image: ["fedora:latest", "opensuse/leap:latest"]
|
2021-08-03 14:53:40 +00:00
|
|
|
steps:
|
2024-05-07 06:49:53 +00:00
|
|
|
- name: Setup Fedora
|
|
|
|
if: ${{ matrix.image == 'fedora:latest' }}
|
2021-08-03 14:53:40 +00:00
|
|
|
run: |
|
|
|
|
dnf install -y \
|
2024-05-07 06:49:53 +00:00
|
|
|
bzip2 curl file gcc-c++ gcc gcc-gfortran git gzip \
|
2021-08-03 14:53:40 +00:00
|
|
|
make patch unzip which xz python3 python3-devel tree \
|
|
|
|
cmake bison bison-devel libstdc++-static
|
2024-05-07 06:49:53 +00:00
|
|
|
- name: Setup OpenSUSE
|
|
|
|
if: ${{ matrix.image == 'opensuse/leap:latest' }}
|
2021-08-03 14:53:40 +00:00
|
|
|
run: |
|
2024-05-07 06:49:53 +00:00
|
|
|
# Harden CI by applying the workaround described here: https://www.suse.com/support/kb/doc/?id=000019505
|
|
|
|
zypper update -y || zypper update -y
|
|
|
|
zypper install -y \
|
|
|
|
bzip2 curl file gcc-c++ gcc gcc-fortran tar git gpg2 gzip \
|
|
|
|
make patch unzip which xz python3 python3-devel tree \
|
2021-08-03 14:53:40 +00:00
|
|
|
cmake bison
|
2022-05-10 14:27:37 +00:00
|
|
|
- name: Checkout
|
2024-05-04 22:49:26 +00:00
|
|
|
uses: actions/checkout@0ad4b8fadaa221de15dcec353f45205ec38ea70b
|
Reorder workflow execution in GHA (#32183)
This patchset refactors our GitHub actions into a single top-level ci workflow that
invokes a series of reusable actions. The main goal of this is to be able to easily
control which tests run and in what order based on the success or failure of top-level
prechecks. Our previous workflows ran in three sets:
* nix tests: style and verification first, then linux and macos tests if successful
* windows tests: style and verification first, then linux and macos tests if successful
* bootstrap tests
As a result, the bootstrap tests ran even if the style failed, and style and verification
had to run on two different platforms despite running identical checks. I'm relatively
sure that's because of the limitation on dependencies between steps in the jobs.
Reusable workflows allow us to run the style, verification and now audit checks once,
then depending on the results, and the files changed, run the appropriate nix, windows
and bootstrap tests. While it saves only a few minutes by itself, this makes it easier to
refactor checks to subset tests without having to replicate tests or other workflow
components in the future.
Co-authored-by: Massimiliano Culpo <massimiliano.culpo@gmail.com>
2022-09-02 21:09:23 +00:00
|
|
|
with:
|
|
|
|
fetch-depth: 0
|
2021-08-03 14:53:40 +00:00
|
|
|
- name: Bootstrap clingo
|
|
|
|
run: |
|
|
|
|
source share/spack/setup-env.sh
|
2023-10-11 17:03:17 +00:00
|
|
|
spack bootstrap disable github-actions-v0.5
|
2022-11-03 09:05:03 +00:00
|
|
|
spack bootstrap disable github-actions-v0.4
|
2021-08-03 14:53:40 +00:00
|
|
|
spack external find cmake bison
|
|
|
|
spack -d solve zlib
|
|
|
|
tree ~/.spack/bootstrap/store/
|
|
|
|
|
2024-05-07 06:49:53 +00:00
|
|
|
clingo-sources:
|
|
|
|
runs-on: ${{ matrix.runner }}
|
|
|
|
strategy:
|
|
|
|
matrix:
|
|
|
|
runner: ['macos-13', 'macos-14', "ubuntu-latest"]
|
2021-11-26 14:32:13 +00:00
|
|
|
steps:
|
2024-05-07 06:49:53 +00:00
|
|
|
- name: Setup macOS
|
|
|
|
if: ${{ matrix.runner != 'ubuntu-latest' }}
|
2021-11-26 14:32:13 +00:00
|
|
|
run: |
|
2024-05-07 06:49:53 +00:00
|
|
|
brew install cmake bison tree
|
2022-05-10 14:27:37 +00:00
|
|
|
- name: Checkout
|
2024-05-04 22:49:26 +00:00
|
|
|
uses: actions/checkout@0ad4b8fadaa221de15dcec353f45205ec38ea70b
|
Reorder workflow execution in GHA (#32183)
This patchset refactors our GitHub actions into a single top-level ci workflow that
invokes a series of reusable actions. The main goal of this is to be able to easily
control which tests run and in what order based on the success or failure of top-level
prechecks. Our previous workflows ran in three sets:
* nix tests: style and verification first, then linux and macos tests if successful
* windows tests: style and verification first, then linux and macos tests if successful
* bootstrap tests
As a result, the bootstrap tests ran even if the style failed, and style and verification
had to run on two different platforms despite running identical checks. I'm relatively
sure that's because of the limitation on dependencies between steps in the jobs.
Reusable workflows allow us to run the style, verification and now audit checks once,
then depending on the results, and the files changed, run the appropriate nix, windows
and bootstrap tests. While it saves only a few minutes by itself, this makes it easier to
refactor checks to subset tests without having to replicate tests or other workflow
components in the future.
Co-authored-by: Massimiliano Culpo <massimiliano.culpo@gmail.com>
2022-09-02 21:09:23 +00:00
|
|
|
with:
|
|
|
|
fetch-depth: 0
|
2024-05-07 06:49:53 +00:00
|
|
|
- uses: actions/setup-python@82c7e631bb3cdc910f68e0081d67478d79c6982d
|
Reorder workflow execution in GHA (#32183)
This patchset refactors our GitHub actions into a single top-level ci workflow that
invokes a series of reusable actions. The main goal of this is to be able to easily
control which tests run and in what order based on the success or failure of top-level
prechecks. Our previous workflows ran in three sets:
* nix tests: style and verification first, then linux and macos tests if successful
* windows tests: style and verification first, then linux and macos tests if successful
* bootstrap tests
As a result, the bootstrap tests ran even if the style failed, and style and verification
had to run on two different platforms despite running identical checks. I'm relatively
sure that's because of the limitation on dependencies between steps in the jobs.
Reusable workflows allow us to run the style, verification and now audit checks once,
then depending on the results, and the files changed, run the appropriate nix, windows
and bootstrap tests. While it saves only a few minutes by itself, this makes it easier to
refactor checks to subset tests without having to replicate tests or other workflow
components in the future.
Co-authored-by: Massimiliano Culpo <massimiliano.culpo@gmail.com>
2022-09-02 21:09:23 +00:00
|
|
|
with:
|
2024-05-07 06:49:53 +00:00
|
|
|
python-version: "3.12"
|
2021-08-03 14:53:40 +00:00
|
|
|
- name: Bootstrap clingo
|
|
|
|
run: |
|
|
|
|
source share/spack/setup-env.sh
|
2023-10-11 17:03:17 +00:00
|
|
|
spack bootstrap disable github-actions-v0.5
|
2022-11-03 09:05:03 +00:00
|
|
|
spack bootstrap disable github-actions-v0.4
|
2024-05-07 06:49:53 +00:00
|
|
|
spack external find --not-buildable cmake bison
|
2021-08-03 14:53:40 +00:00
|
|
|
spack -d solve zlib
|
|
|
|
tree ~/.spack/bootstrap/store/
|
|
|
|
|
2024-05-07 06:49:53 +00:00
|
|
|
gnupg-sources:
|
|
|
|
runs-on: ${{ matrix.runner }}
|
|
|
|
strategy:
|
|
|
|
matrix:
|
|
|
|
runner: [ 'macos-13', 'macos-14', "ubuntu-latest" ]
|
2021-08-03 14:53:40 +00:00
|
|
|
steps:
|
2024-05-07 06:49:53 +00:00
|
|
|
- name: Setup macOS
|
|
|
|
if: ${{ matrix.runner != 'ubuntu-latest' }}
|
2021-08-03 14:53:40 +00:00
|
|
|
run: |
|
2024-05-07 06:49:53 +00:00
|
|
|
brew install tree
|
|
|
|
# Remove GnuPG since we want to bootstrap it
|
|
|
|
sudo rm -rf /usr/local/bin/gpg
|
|
|
|
- name: Setup Ubuntu
|
|
|
|
if: ${{ matrix.runner == 'ubuntu-latest' }}
|
|
|
|
run: |
|
|
|
|
sudo rm -rf $(which gpg) $(which gpg2) $(which patchelf)
|
2022-05-10 14:27:37 +00:00
|
|
|
- name: Checkout
|
2024-05-04 22:49:26 +00:00
|
|
|
uses: actions/checkout@0ad4b8fadaa221de15dcec353f45205ec38ea70b
|
2023-11-03 15:53:45 +00:00
|
|
|
with:
|
2024-05-07 06:49:53 +00:00
|
|
|
fetch-depth: 0
|
|
|
|
- name: Bootstrap GnuPG
|
2021-08-03 14:53:40 +00:00
|
|
|
run: |
|
|
|
|
source share/spack/setup-env.sh
|
2024-05-07 06:49:53 +00:00
|
|
|
spack solve zlib
|
2023-10-11 17:03:17 +00:00
|
|
|
spack bootstrap disable github-actions-v0.5
|
2022-11-03 09:05:03 +00:00
|
|
|
spack bootstrap disable github-actions-v0.4
|
2024-05-07 06:49:53 +00:00
|
|
|
spack -d gpg list
|
2021-08-03 14:53:40 +00:00
|
|
|
tree ~/.spack/bootstrap/store/
|
2021-08-18 18:14:02 +00:00
|
|
|
|
2024-05-07 06:49:53 +00:00
|
|
|
from-binaries:
|
|
|
|
runs-on: ${{ matrix.runner }}
|
2021-08-18 18:14:02 +00:00
|
|
|
strategy:
|
|
|
|
matrix:
|
2024-05-07 06:49:53 +00:00
|
|
|
runner: ['macos-13', 'macos-14', "ubuntu-latest"]
|
2021-08-18 18:14:02 +00:00
|
|
|
steps:
|
2024-05-07 06:49:53 +00:00
|
|
|
- name: Setup macOS
|
|
|
|
if: ${{ matrix.runner != 'ubuntu-latest' }}
|
2021-08-18 18:14:02 +00:00
|
|
|
run: |
|
|
|
|
brew install tree
|
2024-05-07 06:49:53 +00:00
|
|
|
# Remove GnuPG since we want to bootstrap it
|
|
|
|
sudo rm -rf /usr/local/bin/gpg
|
|
|
|
- name: Setup Ubuntu
|
|
|
|
if: ${{ matrix.runner == 'ubuntu-latest' }}
|
2021-08-18 18:14:02 +00:00
|
|
|
run: |
|
2024-05-07 06:49:53 +00:00
|
|
|
sudo rm -rf $(which gpg) $(which gpg2) $(which patchelf)
|
2022-05-10 14:27:37 +00:00
|
|
|
- name: Checkout
|
2024-05-04 22:49:26 +00:00
|
|
|
uses: actions/checkout@0ad4b8fadaa221de15dcec353f45205ec38ea70b
|
2021-08-18 18:14:02 +00:00
|
|
|
with:
|
Reorder workflow execution in GHA (#32183)
This patchset refactors our GitHub actions into a single top-level ci workflow that
invokes a series of reusable actions. The main goal of this is to be able to easily
control which tests run and in what order based on the success or failure of top-level
prechecks. Our previous workflows ran in three sets:
* nix tests: style and verification first, then linux and macos tests if successful
* windows tests: style and verification first, then linux and macos tests if successful
* bootstrap tests
As a result, the bootstrap tests ran even if the style failed, and style and verification
had to run on two different platforms despite running identical checks. I'm relatively
sure that's because of the limitation on dependencies between steps in the jobs.
Reusable workflows allow us to run the style, verification and now audit checks once,
then depending on the results, and the files changed, run the appropriate nix, windows
and bootstrap tests. While it saves only a few minutes by itself, this makes it easier to
refactor checks to subset tests without having to replicate tests or other workflow
components in the future.
Co-authored-by: Massimiliano Culpo <massimiliano.culpo@gmail.com>
2022-09-02 21:09:23 +00:00
|
|
|
fetch-depth: 0
|
2024-05-07 06:49:53 +00:00
|
|
|
- uses: actions/setup-python@82c7e631bb3cdc910f68e0081d67478d79c6982d
|
|
|
|
with:
|
|
|
|
python-version: |
|
|
|
|
3.8
|
|
|
|
3.9
|
|
|
|
3.10
|
|
|
|
3.11
|
|
|
|
3.12
|
|
|
|
- name: Set bootstrap sources
|
2021-08-18 18:14:02 +00:00
|
|
|
run: |
|
2024-05-07 06:49:53 +00:00
|
|
|
source share/spack/setup-env.sh
|
|
|
|
spack bootstrap disable github-actions-v0.4
|
|
|
|
spack bootstrap disable spack-install
|
2021-08-18 18:14:02 +00:00
|
|
|
- name: Bootstrap clingo
|
|
|
|
run: |
|
2024-05-07 06:49:53 +00:00
|
|
|
set -e
|
|
|
|
for ver in '3.8' '3.9' '3.10' '3.11' '3.12' ; do
|
Reorder workflow execution in GHA (#32183)
This patchset refactors our GitHub actions into a single top-level ci workflow that
invokes a series of reusable actions. The main goal of this is to be able to easily
control which tests run and in what order based on the success or failure of top-level
prechecks. Our previous workflows ran in three sets:
* nix tests: style and verification first, then linux and macos tests if successful
* windows tests: style and verification first, then linux and macos tests if successful
* bootstrap tests
As a result, the bootstrap tests ran even if the style failed, and style and verification
had to run on two different platforms despite running identical checks. I'm relatively
sure that's because of the limitation on dependencies between steps in the jobs.
Reusable workflows allow us to run the style, verification and now audit checks once,
then depending on the results, and the files changed, run the appropriate nix, windows
and bootstrap tests. While it saves only a few minutes by itself, this makes it easier to
refactor checks to subset tests without having to replicate tests or other workflow
components in the future.
Co-authored-by: Massimiliano Culpo <massimiliano.culpo@gmail.com>
2022-09-02 21:09:23 +00:00
|
|
|
not_found=1
|
|
|
|
ver_dir="$(find $RUNNER_TOOL_CACHE/Python -wholename "*/${ver}.*/*/bin" | grep . || true)"
|
|
|
|
if [[ -d "$ver_dir" ]] ; then
|
2024-05-07 06:49:53 +00:00
|
|
|
echo "Testing $ver_dir"
|
Reorder workflow execution in GHA (#32183)
This patchset refactors our GitHub actions into a single top-level ci workflow that
invokes a series of reusable actions. The main goal of this is to be able to easily
control which tests run and in what order based on the success or failure of top-level
prechecks. Our previous workflows ran in three sets:
* nix tests: style and verification first, then linux and macos tests if successful
* windows tests: style and verification first, then linux and macos tests if successful
* bootstrap tests
As a result, the bootstrap tests ran even if the style failed, and style and verification
had to run on two different platforms despite running identical checks. I'm relatively
sure that's because of the limitation on dependencies between steps in the jobs.
Reusable workflows allow us to run the style, verification and now audit checks once,
then depending on the results, and the files changed, run the appropriate nix, windows
and bootstrap tests. While it saves only a few minutes by itself, this makes it easier to
refactor checks to subset tests without having to replicate tests or other workflow
components in the future.
Co-authored-by: Massimiliano Culpo <massimiliano.culpo@gmail.com>
2022-09-02 21:09:23 +00:00
|
|
|
if $ver_dir/python --version ; then
|
|
|
|
export PYTHON="$ver_dir/python"
|
|
|
|
not_found=0
|
|
|
|
old_path="$PATH"
|
|
|
|
export PATH="$ver_dir:$PATH"
|
|
|
|
./bin/spack-tmpconfig -b ./.github/workflows/bootstrap-test.sh
|
|
|
|
export PATH="$old_path"
|
|
|
|
fi
|
|
|
|
fi
|
|
|
|
if (($not_found)) ; then
|
|
|
|
echo Required python version $ver not found in runner!
|
|
|
|
exit 1
|
|
|
|
fi
|
|
|
|
done
|
2021-11-03 06:15:24 +00:00
|
|
|
- name: Bootstrap GnuPG
|
|
|
|
run: |
|
|
|
|
source share/spack/setup-env.sh
|
|
|
|
spack -d gpg list
|
|
|
|
tree ~/.spack/bootstrap/store/
|
|
|
|
|