circuitpython/tests
David Lechner d42d35f56d tests/run-tests.py: Enable -X realtime option for macOS tests.
This enables the new `-X realtime` runtime option when running tests on
macOS.  This causes MicroPython to configure all threads to be high
priority so that they are allowed to use high precision timers.  This
makes tests that depend on the passage of time more likely to succeed.

CI tests that were disabled because of this are now enabled again.

Signed-off-by: David Lechner <david@pybricks.com>
2022-05-24 00:52:44 +10:00
..
basics tests/basics: Unlock heap if skipping nanbox small-int test. 2022-05-23 15:45:16 +10:00
cmdline py/compile: Allow new qstrs to be allocated at all compiler passes. 2022-05-17 23:39:22 +10:00
cpydiff py/runtime: Allow multiple *args in a function call. 2022-03-31 16:59:30 +11:00
esp32 tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
extmod tests/extmod: Use bytearray instead of bytes for uctypes test. 2022-05-18 15:23:11 +10:00
feature_check py: Implement partial PEP-498 (f-string) support. 2021-08-14 16:58:40 +10:00
float all: Update Python formatting to latest Black version 22.1.0. 2022-02-02 16:49:55 +11:00
import py/builtinimport: Change relative import's ValueError to ImportError. 2021-05-30 19:35:03 +10:00
inlineasm tests/inlineasm: Add test for PUSH LR and POP PC. 2022-04-11 15:35:42 +10:00
internal_bench tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
io py/modio: Remove io.resource_stream function. 2021-12-17 23:53:44 +11:00
jni tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
micropython py/parse: Allow all constant objects to be used in "X = const(o)". 2022-05-18 16:18:35 +10:00
misc all: Update Python formatting to latest Black version 22.1.0. 2022-02-02 16:49:55 +11:00
multi_bluetooth tests/multi_bluetooth/ble_subscribe.py: Add test for subscription. 2021-08-14 22:44:47 +10:00
multi_net tests/multi_net: Skip SSL test if relevant modules aren't available. 2022-05-17 14:25:51 +10:00
net_hosted extmod/uasyncio: Get addr and bind server socket before creating task. 2021-06-26 22:30:22 +10:00
net_inet tests: Use .errno instead of .args[0] for OSError exceptions. 2021-04-23 22:03:46 +10:00
perf_bench tests/perf_bench: Update .mpy file header to remove old unicode flag. 2022-05-17 14:06:41 +10:00
pyb tests/pyb: Update CAN tests to match revised CAN API. 2022-04-02 22:46:31 +11:00
pybnative tests/pybnative: Make while.py test run on boards without pyb.delay. 2021-09-01 00:43:41 +10:00
qemu-arm qemu-arm: Add tests for freezing viper and asm_thumb code. 2022-02-24 18:29:02 +11:00
renesas-ra tests/renesas-ra: Add tests for renesas-ra port. 2022-04-29 12:29:07 +09:00
stress py: Fix compiling and decoding of *args at large arg positions. 2022-04-01 09:20:42 +11:00
thread tests/thread: Use less resources for stress_aes if settrace enabled. 2022-05-17 14:25:51 +10:00
unicode tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
unix py/malloc: Introduce m_tracked_calloc, m_tracked_free functions. 2022-05-05 10:31:50 +10:00
wipy tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
README tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-internalbench.py tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-multitests.py tests/run-multitests.py: Set HOST_IP so tests work between PC and board. 2022-01-17 17:35:04 +11:00
run-natmodtests.py all: Rename "sys" module to "usys". 2020-09-04 00:10:24 +10:00
run-perfbench.py tests/run-tests.py: Handle case where mpy-cross fails to compile script. 2022-05-23 15:45:21 +10:00
run-tests-exp.py tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-tests-exp.sh tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-tests.py tests/run-tests.py: Enable -X realtime option for macOS tests. 2022-05-24 00:52:44 +10:00

This directory contains tests for various functionality areas of MicroPython.
To run all stable tests, run "run-tests.py" script in this directory.

Tests of capabilities not supported on all platforms should be written
to check for the capability being present. If it is not, the test
should merely output 'SKIP' followed by the line terminator, and call
sys.exit() to raise SystemExit, instead of attempting to test the
missing capability. The testing framework (run-tests.py in this
directory, test_main.c in qemu_arm) recognizes this as a skipped test.

There are a few features for which this mechanism cannot be used to
condition a test. The run-tests.py script uses small scripts in the
feature_check directory to check whether each such feature is present,
and skips the relevant tests if not.

Tests are generally verified by running the test both in MicroPython and
in CPython and comparing the outputs. If the output differs the test fails
and the outputs are saved in a .out and a .exp file respectively.
For tests that cannot be run in CPython, for example because they use
the machine module, a .exp file can be provided next to the test's .py
file. A convenient way to generate that is to run the test, let it fail
(because CPython cannot run it) and then copy the .out file (but not
before checking it manually!)

When creating new tests, anything that relies on float support should go in the
float/ subdirectory.  Anything that relies on import x, where x is not a built-in
module, should go in the import/ subdirectory.