circuitpython/tests
Jeff Epler e6fe55349d run_tests: Parallelism improvements, partial sync with micropython
Take changes from https://github.com/micropython/micropython/pull/3694
(expected to be merged soon) as well as other accumulated stuff from
upstream that we want.

Leave our desired differences, including:
 * silencing warnings in python3
 * renaming the file descriptors returned by openpty()
 * adding ulab tests
 * Adding "." to the import path for skip_if

This speeds up `make test_full` and should also reduce the time in CI
a little bit.
2021-06-03 16:17:47 -05:00
..
basics Merge MicroPython v1.15 into CircuitPython 2021-05-12 17:51:42 -07:00
circuitpython run code formatting script 2021-03-15 19:27:36 +05:30
circuitpython-manual [synthio] add a simple MidiTrack implementation 2021-03-26 16:38:10 -04:00
cmdline Merge MicroPython v1.15 into CircuitPython 2021-05-12 17:51:42 -07:00
cpydiff Merge MicroPython 1.13 into CircuitPython 2021-05-04 18:06:33 -07:00
extmod Merge MicroPython v1.15 into CircuitPython 2021-05-12 17:51:42 -07:00
feature_check Merge MicroPython v1.15 into CircuitPython 2021-05-12 17:51:42 -07:00
float Merge MicroPython 1.14 into CircuitPython 2021-05-11 15:07:40 -07:00
import Merge remote-tracking branch 'adafruit/main' into merge_1.13 2021-05-06 11:17:53 -07:00
inlineasm Merge MicroPython 1.12 into CircuitPython 2021-05-03 14:01:18 -07:00
internal_bench Merge MicroPython 1.12 into CircuitPython 2021-05-03 14:01:18 -07:00
io Merge MicroPython v1.15 into CircuitPython 2021-05-12 17:51:42 -07:00
jni Merge MicroPython v1.15 into CircuitPython 2021-05-12 17:51:42 -07:00
micropython Merge MicroPython 1.14 into CircuitPython 2021-05-11 15:07:40 -07:00
misc Merge MicroPython 1.14 into CircuitPython 2021-05-11 15:07:40 -07:00
perf_bench tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
pybnative codeformat 2021-04-19 22:22:44 -07:00
qemu-arm Merge MicroPython 1.12 into CircuitPython 2021-05-03 14:01:18 -07:00
stress Merge MicroPython 1.12 into CircuitPython 2021-05-03 14:01:18 -07:00
thread Merge MicroPython 1.14 into CircuitPython 2021-05-11 15:07:40 -07:00
unicode codeformat 2021-04-19 22:22:44 -07:00
unix Merge MicroPython 1.14 into CircuitPython 2021-05-11 15:07:40 -07:00
README tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
pyboard.py tests: Remove pyboard.py symlink and instead import from ../tools. 2018-09-05 15:36:33 +10:00
run-internalbench.py Merge MicroPython 1.12 into CircuitPython 2021-05-03 14:01:18 -07:00
run-multitests.py tests/run-multitests.py: Add a -p flag to run permutations of instances. 2020-11-13 17:19:05 +11:00
run-natmodtests.py Merge MicroPython 1.12 into CircuitPython 2021-05-03 14:01:18 -07:00
run-perfbench.py Merge MicroPython 1.12 into CircuitPython 2021-05-03 14:01:18 -07:00
run-tests-exp.py Merge MicroPython v1.15 into CircuitPython 2021-05-12 17:51:42 -07:00
run-tests-exp.sh tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-tests.py run_tests: Parallelism improvements, partial sync with micropython 2021-06-03 16:17:47 -05:00
skip_if.py run code formatting script 2021-03-15 19:27:36 +05:30

README

This directory contains tests for various functionality areas of MicroPython.
To run all stable tests, run "run-tests.py" script in this directory.

Tests of capabilities not supported on all platforms should be written
to check for the capability being present. If it is not, the test
should merely output 'SKIP' followed by the line terminator, and call
sys.exit() to raise SystemExit, instead of attempting to test the
missing capability. The testing framework (run-tests.py in this
directory, test_main.c in qemu_arm) recognizes this as a skipped test.

There are a few features for which this mechanism cannot be used to
condition a test. The run-tests.py script uses small scripts in the
feature_check directory to check whether each such feature is present,
and skips the relevant tests if not.

Tests are generally verified by running the test both in MicroPython and
in CPython and comparing the outputs. If the output differs the test fails
and the outputs are saved in a .out and a .exp file respectively.
For tests that cannot be run in CPython, for example because they use
the machine module, a .exp file can be provided next to the test's .py
file. A convenient way to generate that is to run the test, let it fail
(because CPython cannot run it) and then copy the .out file (but not
before checking it manually!)

When creating new tests, anything that relies on float support should go in the
float/ subdirectory.  Anything that relies on import x, where x is not a built-in
module, should go in the import/ subdirectory.