circuitpython/tests
stijn 405893afc6 tests/run-tests: Use absolute paths where possible.
Replace some usages of paths relative to the current working directory
with absolute paths relative to the tests directory.

Fixes and resulting changes:
- default values of MICROPYTHON and MPYCROSS are absolute paths and
  always correct
- likewise, the correct full paths for tools and extmod directories
  are appended to sys.path
- printing/cleaning failures works properly since it expects the .exp
  and .out files in the tests directory which is also where they
  are written to now, plus no more need for changing directories

This fixes #5872 and allows running custom tests which use run-tests
without having to cd to the tests directory first, and the test output
still is in the tests/ directory instead of the current working directory.

Discovery of tests and all skip test logic based on paths relative to
the current working directory remains unchanged which essentially means
that for running most of MicroPython's own tests, run-tests must still
be ran from within it's directory, so document that.
2020-08-27 11:12:08 +10:00
..
basics py/runtime: Fix builtin compile() in "single" mode so it prints exprs. 2020-08-22 11:38:46 +10:00
cmdline py/compile: Implement PEP 572, assignment expressions with := operator. 2020-06-16 22:02:24 +10:00
cpydiff tests/cpydiff: Add CPy diff test for assignment expression behaviour. 2020-06-16 22:06:47 +10:00
esp32 esp32/modsocket: Fix getaddrinfo to raise on error. 2020-05-09 16:43:48 +10:00
extmod tests/extmod: Make uasyncio_fair test more reliable by adjusting sleeps. 2020-08-26 17:05:52 +10:00
feature_check tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
float py/objcomplex: Add mp_obj_get_complex_maybe for use in complex bin-op. 2020-06-27 01:03:10 +10:00
import tests: Move .mpy import tests from import/ to micropython/ dir. 2020-07-26 22:04:31 +10:00
inlineasm tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
internal_bench tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
io tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
jni tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
micropython py/persistentcode: Maintain root ptr list of imported native .mpy code. 2020-08-02 22:34:09 +10:00
misc tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
multi_bluetooth extmod/modbluetooth: Add event for "indicate acknowledgement". 2020-07-20 23:26:41 +10:00
multi_net extmod/uasyncio: Add StreamReader.readexactly(n) method. 2020-07-25 23:10:05 +10:00
net_hosted tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
net_inet extmod/modussl_mbedtls: Integrate shorter error strings. 2020-07-21 00:31:05 +10:00
perf_bench tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
pyb tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
pybnative tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
qemu-arm qemu-arm: Add testing of frozen native modules. 2019-08-20 15:14:08 +10:00
stress tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
thread tests/thread/thread_stacksize1.py: Increase stack size for CPython. 2020-05-05 00:43:24 +10:00
unicode tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
unix tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
wipy tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
README tests: Make run-tests help and README be more descriptive of behaviour. 2020-01-22 16:35:24 +11:00
run-internalbench.py tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
run-multitests.py tests/run-multitests.py: Allow passing unique env vars to each instance. 2020-06-10 22:41:57 +10:00
run-natmodtests.py tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
run-perfbench.py tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
run-tests tests/run-tests: Use absolute paths where possible. 2020-08-27 11:12:08 +10:00
run-tests-exp.py tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
run-tests-exp.sh run-tests-exp.sh: Typo fix in comment. 2015-02-21 03:22:33 +02:00

README

This directory contains tests for various functionality areas of MicroPython.
To run all stable tests, run "run-tests" script in this directory.

Tests of capabilities not supported on all platforms should be written
to check for the capability being present. If it is not, the test
should merely output 'SKIP' followed by the line terminator, and call
sys.exit() to raise SystemExit, instead of attempting to test the
missing capability. The testing framework (run-tests in this
directory, test_main.c in qemu_arm) recognizes this as a skipped test.

There are a few features for which this mechanism cannot be used to
condition a test. The run-tests script uses small scripts in the
feature_check directory to check whether each such feature is present,
and skips the relevant tests if not.

Tests are generally verified by running the test both in MicroPython and
in CPython and comparing the outputs. If the output differs the test fails
and the outputs are saved in a .out and a .exp file respectively.
For tests that cannot be run in CPython, for example because they use
the machine module, a .exp file can be provided next to the test's .py
file. A convenient way to generate that is to run the test, let it fail
(because CPython cannot run it) and then copy the .out file (but not
before checking it manually!)

When creating new tests, anything that relies on float support should go in the
float/ subdirectory.  Anything that relies on import x, where x is not a built-in
module, should go in the import/ subdirectory.