hlrs-software-stack/spack
7
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
5236 commits 3 branches 52 tags 188 MiB
Commit graph

2167 commits

Author SHA1 Message Date
Todd Gamblin
14278fdf0a Allow file URLs 2014-02-05 00:17:35 -08:00
Todd Gamblin
09300d9261 Ignore more errors when spidering. 2014-02-05 00:17:35 -08:00
Todd Gamblin
7290322d96 Fix spelling error in tmp dir 2014-02-05 00:17:35 -08:00
Todd Gamblin
badb130eff Simplify redundant conditional. 2014-02-05 00:17:35 -08:00
Todd Gamblin
c0ea783310 Fix import bug. 2014-02-05 00:17:34 -08:00
Todd Gamblin
6d956f372f Fix bug in staging. 
- Stage needs to account for symlinks in self.tmp_dir
- Use os.realpath on self.tmp_dir when checking to see if a stage needs to be rebuilt
 2014-02-05 00:17:34 -08:00
Todd Gamblin
03a32f0d5b Can now mirror tarballs in a local directory. 
- Can add tarballs to local directory; no longer have to download from source URL.
 2014-02-05 00:17:34 -08:00
Gregory L. Lee
b4da28f71e bug fixes 
- Make prefix an actual string so that install doesn't fail.
- Executable should throw SpackError on command failure.
 2014-01-23 01:30:44 -08:00
Todd Gamblin
8f7c92706f More typo fixes 2014-01-15 00:46:05 -08:00
Todd Gamblin
cab94f86ee typo fixes from Adam 2014-01-14 23:50:50 -08:00
Todd Gamblin
91d6f0b481 Developer documentation 2014-01-12 18:22:19 +01:00
Todd Gamblin
d18be7437f Remove trailing whitespace from license text 2014-01-12 18:19:18 +01:00
Todd Gamblin
08a25adb2f Site configuration docs 2014-01-11 20:42:48 +01:00
Todd Gamblin
72e54caf06 Add line to disable jekyll on github. 2014-01-09 18:18:38 +01:00
Todd Gamblin
912a87c868 Fix docs to account for license header. 2014-01-09 18:06:18 +01:00
Todd Gamblin
ad746bd686 Add a rule for automatically creating gh-pages from html docs. 2014-01-09 16:35:46 +01:00
Todd Gamblin
0b5d531f31 make empty _static directory "exist" to git 
Sphinx really wants the _static directory to exist, but git doesn't.
This is a compromise to avoid superfluous warnings from sphinx.

See here:

http://stackoverflow.com/questions/115983/how-do-i-add-an-empty-directory-to-a-git-repository
 2014-01-09 14:03:32 +01:00
Todd Gamblin
837fc18d14 Add release number to docs and license. 2014-01-08 11:23:15 +01:00
Todd Gamblin
402c158f3b Change to github URL in docs. 2014-01-08 11:02:12 +01:00
Todd Gamblin
ce9b3511d0 Add license to python files and spack script. 2014-01-08 10:21:35 +01:00
Todd Gamblin
2f520d6119 Change multimethods to take first match instead of being rigid. 
- Formerly required that one and only one spec match
- Now allows first match in a list (more flexible and more intuitive)

- introduces new bug that provides() doesn't do the correct thing
  when a version is not in a range that has been explicitly provided.
- TODO: fix this.
 2014-01-07 09:52:29 +01:00
Todd Gamblin
36e6ef9fbd Packaging docs are mostly done. 2014-01-06 18:21:27 +01:00
Todd Gamblin
40229f6ed2 More packaging docs 2014-01-06 17:15:25 +01:00
Todd Gamblin
4c9c7ab65f Local specs now called "anonymous specs" 
- anonymous specs have no name
- "local spec" came from these first being used in multimethods, i.e. "name of the local Package"
- not the most intuitive name.
 2014-01-06 15:18:15 +01:00
Todd Gamblin
93e288859a Simpler prefix args. 2014-01-06 14:14:57 +01:00
Todd Gamblin
5f2feac92c Remove install methods from mock packages (not needed) 2014-01-06 11:05:58 +01:00
Todd Gamblin
df0c1134c9 SPACK-14: Bugfix in Spec.normalize() 
- Normalize now updates the provider index as it addes package dependencies.
- Fixes problem where this breaks:

  a depends_on mpi
  a depends_on b
  b depends_on mpich

- Packages now restrict the mpi dependency to mpich
 2014-01-06 09:25:51 +01:00
Todd Gamblin
d0b82d291f Change deps on 'mpich' to 'mpi' 2014-01-04 14:44:16 -08:00
Todd Gamblin
b579ba213d More packaging documentation 2014-01-04 14:43:44 -08:00
Todd Gamblin
30d3b32085 Bug fix in how class names are determined 2014-01-03 11:43:29 -08:00
Todd Gamblin
208db9b002 More packaging documentation. 2013-12-26 13:47:13 -08:00
Todd Gamblin
a4cda94524 install() now takes spec AND prefix 2013-12-25 17:19:51 -08:00
Todd Gamblin
0cd5866eea Some fixes recommended by PyCharm 2013-12-25 15:40:32 -08:00
Todd Gamblin
4ff8766a22 Starting on packaging docs. 2013-12-25 15:30:42 -08:00
Todd Gamblin
354c8a281b make create and checksum consistent. 
- create now searches and prompts for checksums.
- makes package creation easier
 2013-12-24 00:57:56 -08:00
Todd Gamblin
2f1eae8c0d spack checksum works. 2013-12-23 16:12:02 -08:00
Todd Gamblin
db32769347 spack edit fixed. 2013-12-23 14:01:10 -08:00
Todd Gamblin
7267734a5b Spack create works again w/new package format. 2013-12-23 12:09:19 -08:00
Todd Gamblin
358bfdaaf1 Another multimethod test for vdeps 2013-12-23 10:28:50 -08:00
Todd Gamblin
87dc2151b7 constrain() now consistent with satisfies() 
- Added checks to constrain() so that it is consistent with satisfies()
- Added many more test cases for satisfiability and constraints on deps
- Virtual packages are handled properly in satisfies() and constrain()
	- bugfix: mpileaks^mpich2 would satisfy mpileaks^mpi@3:
	- this case is now handled.
 2013-12-23 10:19:55 -08:00
Todd Gamblin
7088cdf25f Fix for SPACK-13, and satisfies() now handles deps. 
Added more test cases for multimethods.  In doing so, (re)discovered that
satisfies() really needs to handle dependencies properly.

Implemented support for dependencies in satisfies, but constrain() now
isn't consistent (as we do not currently constrain deps), so need to
implement that.

Virtual dependency support probably needs some deeper thought.  i.e.,
there is probably an intermediate DAG form that would make the needed
checks easier.  Right now we have to build ProviderIndexes to figure out
how virtual dependencies are set up.  If the vdep were preserved in the DAG,
then we could just check for things like incompatible providers directly.
 2013-12-22 17:55:58 -08:00
Todd Gamblin
f7706d231d SPACK-2: Multimethods for specs. 
- multi_function.py -> multimethod.py
- Added @when decorator, which takes a spec and implements matching for method dispatch
- Added multimethod unit test, covers basic cases.
 2013-12-21 17:19:05 -08:00
Todd Gamblin
99b05fd571 More docs. 2013-12-21 15:32:34 -08:00
Todd Gamblin
dfd0440a7e Color tweaks for find. 2013-12-21 15:30:35 -08:00
Todd Gamblin
a63482be73 Docs for spack find 2013-12-21 15:30:35 -08:00
Todd Gamblin
88017ec49e Made formatting specs easier with format() syntax. 
- Replaced existing str_no_deps() function with more flexible format() function.
- Spec.tree() can take a format argument now, as well.
 2013-12-21 15:30:35 -08:00
Todd Gamblin
e645bb065a SPACK-1: Multi-version installation now works front to back with specs. 2013-12-21 15:30:10 -08:00
Todd Gamblin
af639dca16 Make dirty installs part of package lifecycle 2013-12-18 11:42:56 -08:00
Todd Gamblin
c7beac295d More on installing with virtual packages 2013-12-18 11:36:55 -08:00
Todd Gamblin
256c42a34c Added a target to upload docs automatically. 2013-12-18 11:18:11 -08:00
Todd Gamblin
7be511a352 Finished basic usage. 2013-12-18 11:02:31 -08:00
Todd Gamblin
c9e40b725d Start of basic documentation 2013-12-12 04:25:31 -08:00
Todd Gamblin
c7539fe950 Better info command. 2013-12-12 01:04:32 -08:00
Todd Gamblin
7575f99bea Documentation skeleton 2013-12-09 20:17:08 -08:00
Todd Gamblin
8d51c95e68 use get instead of setdefault for kwargs. 2013-12-09 10:44:46 -08:00
Todd Gamblin
936f54761b type(foo) == bar -> isinstance(foo, bar) 
Changed type checks in most places.
 2013-12-09 00:47:17 -08:00
Todd Gamblin
fa2e8dab11 Additional circular reference checking 2013-12-08 21:38:37 -08:00
Todd Gamblin
e0c029c347 Fixes for virtual packages. 
- Added more tests
- cleaned up spec preorder traversal
- fixed concretization
 2013-12-08 19:26:29 -08:00
Todd Gamblin
90f2154a32 Better test output -- include totals. 2013-12-07 15:16:09 -08:00
Todd Gamblin
87fedc7e1e Added support for virtual dependencies ("provides") 2013-12-07 13:51:46 -08:00
Todd Gamblin
344e902b15 More stage tests. 2013-12-01 23:57:07 -08:00
Todd Gamblin
ff2018bc85 Reworked stage paths to allow %u for username. Added stage test. 2013-11-24 14:06:11 -08:00
Todd Gamblin
3de3efc75d Gracefully handle lack of network connection. 2013-11-23 21:01:07 -08:00
Todd Gamblin
1247036141 Generalize package relations like depends_on, provides, conflicts. 
All of these do the same thing.  So they are all now generalized
to a single closure function; just the name of the updated variable
in the package is different.
 2013-11-23 15:46:04 -08:00
Todd Gamblin
6cf6eac3de Move concretization into its own class. 
Allows easy overriding of a single policy.
 2013-11-23 15:18:43 -08:00
Todd Gamblin
f31aaeed98 Cleanup and comments. 2013-11-23 14:55:09 -08:00
Todd Gamblin
2dff2f3341 Fix virtual method. 2013-11-23 13:43:59 -08:00
Todd Gamblin
389fa1792d Added web spider capability for listing versions. 2013-11-23 13:04:36 -08:00
Todd Gamblin
fe7da0dcff Update libdwarf URL. 2013-11-20 14:43:17 -07:00
Todd Gamblin
b5c565891f First cut concretization works, with tests. 
Mock packages now all have their own version lists.
 2013-10-26 14:04:09 -07:00
Todd Gamblin
7bdf93234a Added unit tests for spec normalization. 2013-10-18 16:39:09 -07:00
Todd Gamblin
481a617d65 spack test runs all tests by default 
'spack test -a' formerly ran all test and 'spack test' listed available tests.
Now, 'spack test' runs all tests and 'spack test -l' lists available ones.
 2013-10-17 14:53:40 -07:00
Todd Gamblin
558cf7e406 spec flatten, normalize, validate; package validate 
New operations for manipulating spec and package DAGs.

For specs:
	flatten:   gather all deps to the root
	normalize: Merge constraints and make spec match package DAG

For packages:
	validate_dependencies: Make sure spec constraints in package DAG are sane.

Added tests for above methods.  Also added beginnings of concretization logic,
to turn abstract spec into a concrete one.

Still need proper tests for normalize().
 2013-10-17 14:46:00 -07:00
Todd Gamblin
db07c7f611 Spec constraints and normalization now work. 
- Specs can be "constrained" by other specs, throw exceptions when constraint
  can't be satisfied.

- Normalize will put a spec in DAG form and merge all package constraints with
  the spec.

- Ready to add concretization policies for abstract specs now.
 2013-10-15 03:04:25 -07:00
Todd Gamblin
3fb7699e1e Command to launch interpreter with spack in sys.path 2013-10-11 23:24:06 -07:00
Todd Gamblin
09fd944de5 Command to run pydoc on spack classes. 2013-10-11 23:23:41 -07:00
Todd Gamblin
bb63327da0 Refactor utils into separate modules. 2013-10-07 18:54:58 -07:00
Todd Gamblin
f2046a4aa3 Start to make a bigger package out of utils.py 
- moved none_compare functions to util.none_high
  and util.none_low packages
- renamed utils.py to util package
 2013-10-07 18:12:26 -07:00
Todd Gamblin
618571b807 Checkpoint commit: much-improved spec class. 
Still organizing things.
 2013-10-07 17:57:27 -07:00
Todd Gamblin
157737efbe Add spec architeccture, redo color output support. 2013-06-29 15:59:43 -07:00
Todd Gamblin
ebc507dc6e Clean up half-downloaded tarballs. 2013-06-29 15:59:08 -07:00
Todd Gamblin
7a67cc1675 Adding expression syntax for console colors. 2013-06-29 15:56:29 -07:00
Todd Gamblin
5c761aafab Add checks for version 2.7 2013-06-02 13:54:46 -07:00
Todd Gamblin
8f37817ae1 Better error messages for spack list -v. 2013-05-17 16:56:00 -07:00
Todd Gamblin
57ef3b8a80 Ability to list versions from web page with spack list -v PACKAGE 
Experimental feature automatically parses versions out of web pages and prints what
it thinks are avaialble versions of a package, e.g.:

    $ spack list -v libunwind
    1.1    1.0   0.98.6  0.98.4  0.98.2  0.98  0.96  0.93  0.91  0.1
    1.0.1  0.99  0.98.5  0.98.3  0.98.1  0.97  0.95  0.92  0.9   0.0
 2013-05-17 16:25:00 -07:00
Todd Gamblin
6e557798e8 Added command to print out URL and homepage. 2013-05-17 16:04:56 -07:00
Todd Gamblin
7c98ee9644 Renamed variables called 'spec' to 'path' 2013-05-17 10:38:39 -07:00
Todd Gamblin
eb0832e379 list_modules will now find directories. 2013-05-13 10:35:38 -07:00
Todd Gamblin
b2f78ef78e Added EBNF grammar. 2013-05-12 19:30:55 -07:00
Todd Gamblin
b2a5fef6ad Commands take specs as input instead of names. 
modified clean, create, fetch, install, and uninstall
 2013-05-12 14:17:38 -07:00
Todd Gamblin
ad4411bc9e More rubust spec parsing and error messages 2013-05-12 11:10:36 -07:00
Todd Gamblin
c3f52f0200 Initial implementation of package specs, including parser. 
spec.py can parse full dependence specs like this:
	openmpi@1.4.3:1.4.5%intel+debug ^hwloc@1.2

These will be used to specify how to install packages and their dependencies,
as well as to specify restrictions (e.g., on particular versions) for
dependencies.  e.g.:

class SomePackage(Package):
	depends_on('boost@1.46,1.49')

This would require either of those two versions of boost.

This also moves depends_on out to relations.py and adds
"provides", which will allow packages to provide virtual
dependences.

This is just initial implementation of the parsing and objects
to represent specs.  They're not integrated with packages yet.
 2013-05-09 14:21:16 -07:00
Todd Gamblin
5dd2c53e38 Removed old versions.py 2013-05-09 14:19:03 -07:00
Todd Gamblin
1b1c1c07f9 Don't exit after one test. 2013-05-09 14:18:38 -07:00
Todd Gamblin
fd93d4c235 Changed class name. 2013-05-09 14:18:11 -07:00
Todd Gamblin
2df8a29b9b Removed executable bit. 2013-05-09 14:15:38 -07:00
Todd Gamblin
50718fe57f Tests can be run via spack test <test_name> 2013-04-28 11:27:33 -07:00
Todd Gamblin
422d291b11 This adds support for multi-platform methods. 
You can now do this:
class MyPackage(Package):
    def install(self):
        ...default install...

    @platform('bgqos_0')
    def install(self):
        ...specialized install for bgq...

This works on functions other than install, as well (as long as they're in a Package)
 2013-04-04 10:22:49 -07:00
Todd Gamblin
e1551de976 Moved install-spack to its own simpler command. 2013-03-25 15:27:28 -07:00
Todd Gamblin
aa0fd6c17a Fix in docs. 2013-03-22 16:24:44 -07:00
Todd Gamblin
269cf53a68 Documentation and small changes. 2013-03-22 13:46:01 -07:00
Todd Gamblin
e410df743a Simpler implementation of depends_on. 2013-02-25 18:18:48 -08:00
Todd Gamblin
27b9204785 Better spack -h: added cmd descriptions. 
- each cmd has a desscription attribute that is used for the help strign in argparse.
 2013-02-22 00:20:24 -08:00
Todd Gamblin
707db8dafe Better handling of stage. 
- better symlink handling
- remove stage directories on successful install.
 2013-02-21 23:03:40 -08:00
Todd Gamblin
5899308ad3 Parallel bootstrap for cmake. 2013-02-21 20:05:11 -08:00
Todd Gamblin
bd59689fdc Minor changes; loosened up parallel build for dwarf. 2013-02-21 19:27:27 -08:00
Todd Gamblin
b39165b999 Fix regression in clean. 2013-02-21 19:10:28 -08:00
Todd Gamblin
2a908d6a0e Added help command and purge command. 2013-02-21 19:05:56 -08:00
Todd Gamblin
705447bdc2 Use tmp directory for downloading and building 2013-02-21 19:05:16 -08:00
Todd Gamblin
1c4e16afdf Fixed bug in parallel make option. 2013-02-20 15:44:25 -08:00
Todd Gamblin
fb172bc702 Added libunwind and fixed link issues in cc. 2013-02-20 15:22:00 -08:00
Todd Gamblin
48b0351945 Fixed passing of dependence prefixes to cc. libdwarf works. 2013-02-19 19:26:54 -08:00
Todd Gamblin
d534c539d4 Fixes, remove parallel build for libdwarf due to race case. 2013-02-19 17:08:38 -08:00
Todd Gamblin
7d9d4f3484 rpaths for dependencies. elf, dwarf, cmake build on Linux 2013-02-19 01:20:50 -08:00
Todd Gamblin
5d81cfdac6 Require python2.7 2013-02-18 23:52:50 -08:00
Todd Gamblin
38becacace Dependencies now work. Added libelf, libdwarf. 2013-02-18 23:46:04 -08:00
Todd Gamblin
cc76c0f5f9 Initial version of spack with one package: cmake 2013-02-13 17:50:44 -08:00