20fc14e6b3
ecos: result merging repaired
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1938 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-20 15:01:37 +00:00
4f48eb3232
ecos: send mandatory ecos_test_result when sanity check fails
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1929 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-13 16:26:58 +00:00
4cce602bca
ecos: actually enqueue jobs
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1928 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-13 00:17:33 +00:00
7b3e5986d1
ecos: save experiment runtime
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1927 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-13 00:17:31 +00:00
077f7ea507
ecos: load existing results on campaign startup
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1926 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-13 00:17:28 +00:00
9decf95a09
ecos: specific traps are OK for two benchmarks
...
The "except1" and "clockcnv" benchmarks explicitly cause a trap and handle
it in their own trap handler. This, of course, isn't a bad experiment
outcome.
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1923 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-13 00:17:18 +00:00
a0e6ddd519
ecos: fault-space cutoff specific for this campaign
...
For the eCos kernel test campaign we define a relatively "special" metric
to compare FI results from different applications: Instead of aligning
the fault-space dimensions (e.g., by artificially adding "don't care" space
to the right for shorter application variants), we only keep the data
address axis constant. The rationale behind this is that -- despite the
benchmark applications' run-to-completion behavior -- an operating system's
scheduler usually runs ad infinitum, and that we therefore can extrapolate
from a short application run to any longer period.
In essence, this means we use a failure/experiment-length quotient (ignoring
the Y axis for simplicity, as it is constant in size) to compare
application variants, instead of an absolute failure count. One important
side effect is that we do not punish any application slowdown with this
metric. (And simply prolongating non-susceptible program sections with,
e.g., NOPs, seemingly "improves" fault tolerance.)
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1922 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-12 13:55:45 +00:00
464bc9390b
ecos: campaign rewritten
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1920 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-12 10:59:35 +00:00
283d946295
ecos: no need for experimentInfo.hpp.sh anymore
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1918 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-12 10:59:28 +00:00
4957cfb71b
ecos: remove hard-coded trace filename
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1913 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-10 16:13:59 +00:00
0ab4f12b7c
ecos: no need for clearListeners anymore
...
Since r1700, listeners remove themselves when they leave their scope.
A restore() call also implicitly clears all listeners.
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1912 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-09 15:37:33 +00:00
661563125e
ecos: cosmetics / compiler warning
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1910 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-09 15:37:27 +00:00
1292b66043
ecos: image/prerequisite/result path naming changes
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1909 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-09 15:37:24 +00:00
c2242f2bb4
ecos: guest-image independent fail client
...
TODO: campaign needs to be updated, too
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1908 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-09 15:37:21 +00:00
a26aeb52ee
ecos: preparations for guest-image independent fail client
...
Additional change: prerequisite data files are not opened in append mode
anymore. These files can be easily reproduced, and append mode does more harm
than good here.
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1906 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-09 15:37:14 +00:00
126fb1a1ff
ecos_kernel_test: remove 2nd reboot (which was just before a restore)
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1889 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-07 16:01:35 +00:00
b7bbcd389f
ecos_kernel_test: record error detected/corrected
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1882 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-06 10:51:41 +00:00
9e5de7b14a
ecos_kernel_test bugfix: timer granularity of 10s is way too coarse
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1877 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-11-02 16:59:07 +00:00
34d89000cf
ecos_kernel_test: simplification (no need to call clearListeners() here).
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1843 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-10-25 15:52:55 +00:00
a911ebb353
Revert "explicit aspect activation"
...
Unfortunately, this does not (yet) work as advertised. I need to fight another
round of CMake battles before retrying. Reverting to previous state for now.
This reverts r1753.
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1767 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-10-19 09:45:00 +00:00
a29ad39f5e
explicit aspect activation
...
ag++ is now called with a list of currently active aspect headers
(ag++ -a aspect1.ah -a aspect2.ah ...). This resolves several problems at
once:
- Build directories may be positioned arbitrarily now, they need not be
a subdirectory of the project anymore.
- Multiple build directories can coexist within the project tree. Before
this commit, the generated instantiate-*.ah aspect headers disturbed
neighboring build trees.
- Due to this, the regression test should be runnable much more easily
now.
- The build time was reduced by an average of about 10%.
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1753 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-10-17 15:22:23 +00:00
d983aecf73
added missing dependencies on protobuf library
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1672 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-09-20 17:22:05 +00:00
f9c96ddf2d
prefix internal libraries to avoid naming conflicts with system libraries
...
This is a precaution to avoid current and future naming conflicts with
common system libraries. libutil (part of libc) is the first, but probably
not the last example that already caused trouble twice.
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1614 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-09-12 07:52:30 +00:00
8eb7bd129a
ecos_kernel_test: take width of memory accesses into account for determining bounds
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1591 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-09-05 09:05:11 +00:00
e56918e40e
centralized and cmake-based campaign server+port config
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1590 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-09-04 13:57:01 +00:00
8d2fea7521
ecos_kernel_test: fixed assertion
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1589 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-09-03 14:01:29 +00:00
b33609ef1d
ecos_kernel_test: removed crude workarounds for bugs that have been fixed lately
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1588 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-09-03 13:14:47 +00:00
e6546c1365
limit number of sequential FAIL* experiments to 50, in order to prevent swapping
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1494 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-08-15 11:05:27 +00:00
2b72988203
ecos_kernel_test: wait more than once for test_output breakpoint
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1493 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-08-14 12:47:41 +00:00
b139c71053
ecos_kernel_test: experiment calculates timeout in STEP 2
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1492 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-08-14 09:32:07 +00:00
f72a180f91
ecos_kernel_test: adjustments on experimentInfo.hpp
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1482 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-08-09 15:52:23 +00:00
57621b07a6
ecos_kernel_test: wait with timer in step 0 again, otherwise bochs crashes ; updated binaries
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1479 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-08-08 14:57:56 +00:00
12a762dcda
ecos_kernel_test: detect memory access outside of bounds from the golden run
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1478 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-08-08 14:20:56 +00:00
b5b06a0448
ecos_kernel_test: transfer instr_count, lowest- and highest_addr between STEP 2 and 3
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1477 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-08-08 14:20:53 +00:00
829b08c31c
ecos_kernel_test: experiment cleanup
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1476 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-08-08 14:20:50 +00:00
ff8cb88ab9
ecos_kernel_test: STEP 2: record memory access range
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1475 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-08-08 14:20:47 +00:00
ad42c5b04a
ecos_kernel_test: for step 0, just wait until 'ECOS_FUNC_FINISH' ; don't use a timer
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1474 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-08-08 14:20:44 +00:00
486bf7e1d0
experiment update due to refacatoring of rev 1448
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1472 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-08-06 14:04:18 +00:00
0fbe3d7cfd
ecos_kernel_test experiment update
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1444 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-07-10 10:38:16 +00:00
bc922a98d3
ecos_kernel_test: merge experiment steps 0-2 into a single run
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1443 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-07-09 13:58:47 +00:00
596f4c0644
new experiment: ecos_kernel_test
...
git-svn-id: https://www4.informatik.uni-erlangen.de/i4svn/danceos/trunk/devel/fail@1426 8c4709b5-6ec9-48aa-a5cd-a96041d1645a
2012-07-05 14:37:38 +00:00
