Commit Graph

97 Commits

Author SHA1 Message Date
Japheth Lim 4c89da8b0c regression: restore Python 3 compat. 2016-02-25 11:44:49 +11:00
Japheth Lim 66e94dcf76 regression: decode test output as UTF-8, not ASCII. 2016-02-19 12:00:03 +11:00
Japheth Lim b1ba5037c4 regression: compatibility fix for very old versions of bash (Mac OS). 2016-02-17 14:59:42 +11:00
Rafal Kolanski 4c18f6606b Merge pull request #17 in SEL4/l4v from ~JALIM/l4v:master to master
* commit '63f1a0854a58a9c39d64d7ca8482bf2dd65b68c5':
  regression: add --grace-period option to allow tests to clean up.
2016-02-17 03:56:25 +00:00
Japheth Lim 63f1a0854a regression: add --grace-period option to allow tests to clean up. 2016-02-17 11:19:13 +11:00
Gao Xin bee4ba0052 l4v-sabre: fix refine 2016-02-17 11:18:02 +11:00
Thomas Sewell 9c563f01ca L4V support for using skip cache.
Ignore the cache files. Also, add a flag which has run_tests.sh
build the skip cache.
2016-02-10 15:39:47 +11:00
Japheth Lim ec49042ec8 regression: fix bug in -x (from 5c776152b). 2016-02-05 12:16:21 +11:00
Rafal Kolanski 557418e8da jedit goto-error macro doc: installation path can be subdir
Since writing this, we have discovered that macros can live in arbitrary
hierarchies inside the macros folder, e.g. jedit/macros/Isabelle/, which
then show up in the macros menu. Very nice. Installation instructions
updated.
2016-02-05 09:49:42 +11:00
Japheth Lim 5c776152b3 regression: add -x option to exclude tests from running. 2016-02-04 15:22:39 +11:00
Japheth Lim 404b779e21 regression: add --fail-fast option; refactor stringly typed code. 2016-02-03 17:44:12 +11:00
Japheth Lim e409f357e9 trivial: regression: fix comment about floating-point discrepancy. 2016-02-03 14:22:01 +11:00
Japheth Lim 2f94189c7b regression: detect builds that get stuck without using CPU.
Such builds would have bypassed the cpu-timeout test settings
but can now be detected and killed.
2016-02-02 17:58:19 +11:00
Japheth Lim 253b04f6d9 regression: use CPU instead of real-time timeouts for all tests.
Also update and clarify test spec documentation.
2016-02-01 19:51:13 +11:00
Japheth Lim 0001e839bc regression: fix floating-point rounding that would fail the CPU monotonicity check. 2016-02-01 16:47:28 +11:00
Japheth Lim 25fc04eae0 regression: only print start-of-test messages if stdout is a tty.
This avoids clutter in non-tty outputs, such as regression emails.
2016-02-01 16:26:41 +11:00
Japheth Lim 625c15626d Merge pull request #9 in SEL4/l4v from regression-cputime to master
* commit '84e5f7d81403549f9d88fab3bf0da02b657f47bc':
  regression: change CPU time non-mono from an error to a warning, so that it doesn't kill an otherwise working build.
  style: regression: refactor use of print_test_line.
  regression: report CPU usage; support timeouts based on CPU usage.
2016-02-01 05:23:47 +00:00
Japheth Lim 84e5f7d814 regression: change CPU time non-mono from an error to a warning, so that it doesn't kill an otherwise working build. 2016-02-01 16:15:14 +11:00
Japheth Lim ac29ffc539 Merge pull request #7 in SEL4/l4v from ~CRICHARDSON/l4v:python3 to master
* commit 'af60787317365e05fe03df3d98a41fe9b8740b04':
  various scripts: use print_function uniformly for python3 compat
  regression: decode test output immediately
  regression: python3 compat, use byte literals where bytes are expected
  regression: python3 compat, Queue -> queue
2016-01-29 06:27:58 +00:00
Daniel Matichuk 8884a09a13 update isabelle settings to set L4V_ARCH to ARM by default 2016-01-29 13:46:26 +11:00
Japheth Lim 19b4b76ea8 style: regression: refactor use of print_test_line. 2016-01-29 11:53:52 +11:00
Corey Richardson af60787317
various scripts: use print_function uniformly for python3 compat 2016-01-28 16:11:07 +11:00
Daniel Matichuk 62e44db4df arch_split: fixed test_spec 2016-01-28 15:13:11 +11:00
Japheth Lim 197f48a25f regression: report CPU usage; support timeouts based on CPU usage. 2016-01-27 19:24:42 +11:00
Corey Richardson 5370e01b67
regression: decode test output immediately 2016-01-22 15:16:58 +11:00
Corey Richardson 8133f8a292
regression: python3 compat, use byte literals where bytes are expected 2016-01-21 19:00:06 +11:00
Corey Richardson e6d3bd31f8
regression: python3 compat, Queue -> queue 2016-01-21 18:59:30 +11:00
Daniel Matichuk c282969c54 Merge remote-tracking branch 'verification/master' into arch_split 2016-01-21 10:22:48 +11:00
Japheth Lim dcce50ce79 regression: make --junit-report output more Bamboo-friendly. 2016-01-14 15:55:43 +11:00
Japheth Lim ea38a3303d regression: get dependency tracking to work again. 2016-01-14 11:59:20 +11:00
Japheth Lim 2c7a36e4f1 regression: fix a bug that prevented the printing of failure logs. 2016-01-14 11:27:08 +11:00
Japheth Lim 5892043915 regression: add option to produce JUnit-style report. For Bamboo usage. 2016-01-13 18:01:23 +11:00
Japheth Lim 0afc807807 regression: remove assertion because it may go off spuriously for skipped tests. 2016-01-13 17:10:31 +11:00
Japheth Lim aab9c38901 regression: prefer explicit isabelle path over using PATH. 2016-01-13 16:59:25 +11:00
Japheth Lim 65e98199e1 regression: adjust unnecessarily large test timeouts.
Some tests had timeouts of up to 4 hours. Note that timeouts are
applied on a per-test basis, not per-testsuite. This is now clarified
in the tests.xml documentation.
2016-01-13 16:59:25 +11:00
Japheth Lim e66cba5466 regression: handle dependencies correctly for manually specified tests. 2016-01-13 16:59:25 +11:00
Daniel Matichuk fad2c6aae9 paramatrised abstract and haskell specs over L4V_ARCH
Haskell translator was modified to support multiple translations
of the haskell, with different build parameters.
2016-01-13 12:01:40 +11:00
Japheth Lim cf1dc6852f regression: don't try to kill pids that have already finished.
Reduces errors due to pid reuse, such as in this regression build
  Regression SUCCESS (2015-12-11 04:55:36)
2016-01-11 15:34:36 +11:00
Japheth Lim 46afb6d0fd regression: fix status line behaviour to match docs. 2016-01-08 17:06:54 +11:00
Matthew Fernandez 81fe5cbd67 misc/pysymbols: Merge some CAmkES functionality for generating apply-style.
This commit resurrects some bitrotted support for generating apply-style proofs
from Python. It is somewhat incomplete and untested, but can serve to make
template proofs much more readable.
2016-01-08 15:47:14 +11:00
Matthew Fernandez de77df45aa misc/pysymbols: Move IsaSymbolsException to a separate file. 2016-01-08 15:47:04 +11:00
Japheth Lim 71143907be regression: Python style fixes (credit: Matt F). 2016-01-07 20:41:45 +11:00
Japheth Lim 26eb9eba44 trivial: regression: revert unintended change in timeout handling. 2016-01-07 17:56:18 +11:00
Japheth Lim 2cdbadca87 regression: add status line for ttys; fix timeout and Python var scoping. 2016-01-07 17:49:22 +11:00
Japheth Lim 7d24c4a5b5 regression: parallelise run_tests.py. New options: -j, --legacy-status. 2016-01-07 17:22:00 +11:00
Gerwin Klein da5f50aa94 Merge pull request #3 in SEL4/l4v from ~MFERNANDEZ/l4v:23e130d5-6f13-4fa3-ae00-e1c8174f2cb9 to master
* commit '56dfa8cca7981055b50969cdf787f2557e827233':
  misc: Add vim syntax files.
2016-01-06 04:03:13 +00:00
Matthew Fernandez 56dfa8cca7 misc: Add vim syntax files. 2016-01-06 13:57:08 +11:00
Matthew Fernandez 17538634db misc: Replace inline file merge implementation with isasymbols.
This change means we no longer need to manually update these files when
Isabelle incorporates new unicode symbols. In particular, these translators
will automatically gain support for symbols like "\<longlonglongrightarrow>"
when we move to Isabelle 2016.
2016-01-04 14:01:22 +11:00
Corey Richardson 1ad00aa1ae misc/regression/memusage.py: work around psutil API changes
Closes #5
2015-10-28 18:49:55 +11:00
Matthew Fernandez 5294d36438 misc/pysymbols: Support for sub/superscripts in code blocks.
Inline code from a Markdown source (`like this`) is typically translated
without the assistance of Pygments. As a result we don't get automatic
subscript and superscript support, and need to roll our own. This translation
is pretty blunt and fragile. Expect it to fall over in a TeX error if you pass,
e.g., a "\<^bsub>" without a closing "\<^esub>".
2015-10-15 15:02:45 +11:00