circuitpython/tests
Jim Mussared 59a7865a7d tests/run-multitests.py: Add shortcuts for local Python instances.
One can now use `-i micropython` and `-i cpython` to add instances using
the `MICROPYTHON` and `CPYTHON3` variables (which can be overridden by env
vars).
2020-04-29 16:45:46 +10:00
..
basics py/objdict: Fix popitem for ordered dicts. 2020-04-27 23:53:17 +10:00
cmdline tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
cpydiff tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
esp32 esp32: Consolidate check_esp_err functions and add IDF error string. 2020-04-23 10:59:07 +10:00
extmod tests/extmod: Add btree test for errors raised by btree DB library. 2020-04-27 23:59:09 +10:00
feature_check tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
float py/objint: Do not use fpclassify. 2020-04-18 22:42:24 +10:00
import tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
inlineasm tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
internal_bench tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
io tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
jni tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
micropython py/parse: Remove unnecessary check in const folding for ** operator. 2020-04-09 16:02:39 +10:00
misc tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
multi_bluetooth tests/multi_bluetooth/ble_gap_advertise: Fix bytes/str compare warning. 2020-04-29 16:45:46 +10:00
multi_net tests/multi_net: Add uasyncio test for TCP server and client. 2020-03-26 01:25:45 +11:00
net_hosted tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
net_inet tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
perf_bench tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
pyb tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
pybnative tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
qemu-arm qemu-arm: Add testing of frozen native modules. 2019-08-20 15:14:08 +10:00
stress tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
thread py/scheduler: Add assert that scheduler is locked when unlocking. 2020-04-13 21:55:47 +10:00
unicode tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
unix tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
wipy tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
README tests: Make run-tests help and README be more descriptive of behaviour. 2020-01-22 16:35:24 +11:00
run-internalbench.py tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
run-multitests.py tests/run-multitests.py: Add shortcuts for local Python instances. 2020-04-29 16:45:46 +10:00
run-natmodtests.py tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
run-perfbench.py tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
run-tests tests/run-tests: Make diff tool user configurable. 2020-04-13 16:43:01 +10:00
run-tests-exp.py tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
run-tests-exp.sh run-tests-exp.sh: Typo fix in comment. 2015-02-21 03:22:33 +02:00

This directory contains tests for various functionality areas of MicroPython.
To run all stable tests, run "run-tests" script in this directory.

Tests of capabilities not supported on all platforms should be written
to check for the capability being present. If it is not, the test
should merely output 'SKIP' followed by the line terminator, and call
sys.exit() to raise SystemExit, instead of attempting to test the
missing capability. The testing framework (run-tests in this
directory, test_main.c in qemu_arm) recognizes this as a skipped test.

There are a few features for which this mechanism cannot be used to
condition a test. The run-tests script uses small scripts in the
feature_check directory to check whether each such feature is present,
and skips the relevant tests if not.

Tests are generally verified by running the test both in MicroPython and
in CPython and comparing the outputs. If the output differs the test fails
and the outputs are saved in a .out and a .exp file respectively.
For tests that cannot be run in CPython, for example because they use
the machine module, a .exp file can be provided next to the test's .py
file. A convenient way to generate that is to run the test, let it fail
(because CPython cannot run it) and then copy the .out file (but not
before checking it manually!)

When creating new tests, anything that relies on float support should go in the
float/ subdirectory.  Anything that relies on import x, where x is not a built-in
module, should go in the import/ subdirectory.