bugfix: infinite loop when building a set from incomplete specs (#20649)

This code in `SpecBuilder.build_specs()` introduced in #20203, can loop
seemingly interminably for very large specs:

```python
set([spec.root for spec in self._specs.values()])
```

It's deceptive, because it seems like there must be an issue with
`spec.root`, but that works fine. It's building the set afterwards that
takes forever, at least on `r-rminer`. Currently if you try running
`spack solve r-rminer`, it loops infinitely and spins up your fan.

The issue (I think) is that the spec is not yet complete when this is
run, and something is going wrong when constructing and comparing so many
values produced by `_cmp_key()`. We can investigate the efficiency of
`_cmp_key()` separately, but for now, the fix is:

```python
roots = [spec.root for spec in self._specs.values()]
roots = dict((id(r), r) for r in roots)
```

We know the specs in `self._specs` are distinct (they just came out of
the solver), so we can just use their `id()` to unique them here. This
gets rid of the infinite loop.
This commit is contained in:
Todd Gamblin 2021-01-04 01:28:16 -08:00 committed by GitHub
parent 4c23d99e7d
commit 16ce207481
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23

View file

@ -1601,7 +1601,12 @@ def build_specs(self, function_tuples):
# fix flags after all specs are constructed # fix flags after all specs are constructed
self.reorder_flags() self.reorder_flags()
for root in set([spec.root for spec in self._specs.values()]): # inject patches -- note that we' can't use set() to unique the
# roots here, because the specs aren't complete, and the hash
# function will loop forever.
roots = [spec.root for spec in self._specs.values()]
roots = dict((id(r), r) for r in roots)
for root in roots.values():
spack.spec.Spec.inject_patches_variant(root) spack.spec.Spec.inject_patches_variant(root)
# Add external paths to specs with just external modules # Add external paths to specs with just external modules