circuitpython/tests
Damien George 1786dacc83 tests/run-tests.py: Allow running tests via mpy-cross on remote targets.
This adds support for the `--via-mpy` and `--emit native` options when
running tests on remote targets (via pyboard.py).  It's now possible to do:

    $ ./run-tests.py --target pyboard --via-mpy
    $ ./run-tests.py --target pyboard --via-mpy --emit native

Signed-off-by: Damien George <damien@micropython.org>
2022-05-19 17:31:56 +10:00
..
basics tests: Fix tests to use sys.implementation._mpy. 2022-05-17 09:46:40 +10:00
cmdline py/compile: Allow new qstrs to be allocated at all compiler passes. 2022-05-17 23:39:22 +10:00
cpydiff py/runtime: Allow multiple *args in a function call. 2022-03-31 16:59:30 +11:00
esp32 tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
extmod tests/extmod: Use bytearray instead of bytes for uctypes test. 2022-05-18 15:23:11 +10:00
feature_check py: Implement partial PEP-498 (f-string) support. 2021-08-14 16:58:40 +10:00
float all: Update Python formatting to latest Black version 22.1.0. 2022-02-02 16:49:55 +11:00
import py/builtinimport: Change relative import's ValueError to ImportError. 2021-05-30 19:35:03 +10:00
inlineasm tests/inlineasm: Add test for PUSH LR and POP PC. 2022-04-11 15:35:42 +10:00
internal_bench tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
io py/modio: Remove io.resource_stream function. 2021-12-17 23:53:44 +11:00
jni tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
micropython py/parse: Allow all constant objects to be used in "X = const(o)". 2022-05-18 16:18:35 +10:00
misc all: Update Python formatting to latest Black version 22.1.0. 2022-02-02 16:49:55 +11:00
multi_bluetooth tests/multi_bluetooth/ble_subscribe.py: Add test for subscription. 2021-08-14 22:44:47 +10:00
multi_net tests/multi_net: Skip SSL test if relevant modules aren't available. 2022-05-17 14:25:51 +10:00
net_hosted extmod/uasyncio: Get addr and bind server socket before creating task. 2021-06-26 22:30:22 +10:00
net_inet tests: Use .errno instead of .args[0] for OSError exceptions. 2021-04-23 22:03:46 +10:00
perf_bench tests/perf_bench: Update .mpy file header to remove old unicode flag. 2022-05-17 14:06:41 +10:00
pyb tests/pyb: Update CAN tests to match revised CAN API. 2022-04-02 22:46:31 +11:00
pybnative tests/pybnative: Make while.py test run on boards without pyb.delay. 2021-09-01 00:43:41 +10:00
qemu-arm qemu-arm: Add tests for freezing viper and asm_thumb code. 2022-02-24 18:29:02 +11:00
renesas-ra tests/renesas-ra: Add tests for renesas-ra port. 2022-04-29 12:29:07 +09:00
stress py: Fix compiling and decoding of *args at large arg positions. 2022-04-01 09:20:42 +11:00
thread tests/thread: Use less resources for stress_aes if settrace enabled. 2022-05-17 14:25:51 +10:00
unicode tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
unix py/malloc: Introduce m_tracked_calloc, m_tracked_free functions. 2022-05-05 10:31:50 +10:00
wipy tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
README tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-internalbench.py tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-multitests.py tests/run-multitests.py: Set HOST_IP so tests work between PC and board. 2022-01-17 17:35:04 +11:00
run-natmodtests.py all: Rename "sys" module to "usys". 2020-09-04 00:10:24 +10:00
run-perfbench.py tests/run-perfbench.py: Return error code if any test fails on target. 2022-05-17 14:06:41 +10:00
run-tests-exp.py tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-tests-exp.sh tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-tests.py tests/run-tests.py: Allow running tests via mpy-cross on remote targets. 2022-05-19 17:31:56 +10:00

This directory contains tests for various functionality areas of MicroPython.
To run all stable tests, run "run-tests.py" script in this directory.

Tests of capabilities not supported on all platforms should be written
to check for the capability being present. If it is not, the test
should merely output 'SKIP' followed by the line terminator, and call
sys.exit() to raise SystemExit, instead of attempting to test the
missing capability. The testing framework (run-tests.py in this
directory, test_main.c in qemu_arm) recognizes this as a skipped test.

There are a few features for which this mechanism cannot be used to
condition a test. The run-tests.py script uses small scripts in the
feature_check directory to check whether each such feature is present,
and skips the relevant tests if not.

Tests are generally verified by running the test both in MicroPython and
in CPython and comparing the outputs. If the output differs the test fails
and the outputs are saved in a .out and a .exp file respectively.
For tests that cannot be run in CPython, for example because they use
the machine module, a .exp file can be provided next to the test's .py
file. A convenient way to generate that is to run the test, let it fail
(because CPython cannot run it) and then copy the .out file (but not
before checking it manually!)

When creating new tests, anything that relies on float support should go in the
float/ subdirectory.  Anything that relies on import x, where x is not a built-in
module, should go in the import/ subdirectory.