circuitpython/tests
Macarthur Inbody 34d4dab683 extmod/modurandom: Add error message when getrandbits has bad value.
The random module's getrandbits() method didn't give a proper error message
when calling it with a value that was outside of the range of 1-32, which
can lead to confusion using this function (which under CPython can accept
numbers larger than 32).  Now instead of simply giving a ValueError it
gives an error message that states that the number of bits is constrained.

Also, since the random module's functions getrandbits() and randint()
differ from CPython, tests have been added to describe these differences.
For getrandbits the relevant documentation is shown and added to the docs.
The same is given for randint method so that the information is more easily
found.

Finally, since the int object lacks the bit_length() method there is a test
for that method also to include within the docs, showing the difference to
CPython.
2021-05-30 16:41:30 +10:00
..
basics tests/basics: Split out literal tests that raise SyntaxWarning on CPy. 2021-05-30 13:41:37 +10:00
cmdline unix: Improve command line argument processing. 2021-04-07 12:41:25 +10:00
cpydiff extmod/modurandom: Add error message when getrandbits has bad value. 2021-05-30 16:41:30 +10:00
esp32 tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
extmod tests/extmod/btree_gc.py: Close the database to avoid a memory leak. 2021-05-30 11:50:51 +10:00
feature_check tests/feature_check: Check for lack of pass result rather than failure. 2021-04-15 00:52:56 +10:00
float tests: Make float and framebuf tests skip or run on big-endian archs. 2021-05-26 16:33:18 +10:00
import tests: Move .mpy import tests from import/ to micropython/ dir. 2020-07-26 22:04:31 +10:00
inlineasm tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
internal_bench tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
io extmod/vfs_posix_file: Allow closing an already closed file. 2021-02-11 22:54:41 +11:00
jni tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
micropython py/emitnative: Fix x86-64 emitter to generate correct 8/16-bit stores. 2021-05-20 23:43:25 +10:00
misc tests/misc/sys_settrace_features.py: Fix running with non-dflt encoding. 2020-12-18 13:57:17 +11:00
multi_bluetooth tests/multi_bluetooth: Add performance test for gatt char writes. 2021-04-30 16:14:48 +10:00
multi_net tests: Use .errno instead of .args[0] for OSError exceptions. 2021-04-23 22:03:46 +10:00
net_hosted tests: Use .errno instead of .args[0] for OSError exceptions. 2021-04-23 22:03:46 +10:00
net_inet tests: Use .errno instead of .args[0] for OSError exceptions. 2021-04-23 22:03:46 +10:00
perf_bench tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
pyb tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
pybnative tests: Move native for test from pybnative to micropython. 2021-01-29 23:57:10 +11:00
qemu-arm qemu-arm: Add testing of frozen native modules. 2019-08-20 15:14:08 +10:00
stress tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
thread tests/thread: Make exc1,exit1,exit2,stacksize1,start1 tests run on rp2. 2021-05-10 13:07:16 +10:00
unicode tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
unix unix/modffi: Use a union for passing/returning FFI values. 2021-05-06 12:17:10 +10:00
wipy tests: Format all Python code with black, except tests in basics subdir. 2020-03-30 13:21:58 +11:00
README tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-internalbench.py tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-multitests.py tests/run-multitests.py: Flush stdout for each line of trace output. 2021-05-13 16:26:07 +10:00
run-natmodtests.py all: Rename "sys" module to "usys". 2020-09-04 00:10:24 +10:00
run-perfbench.py tests/run-perfbench.py: Fix native feature check. 2021-05-11 23:45:36 +10:00
run-tests-exp.py tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-tests-exp.sh tests: Rename run-tests to run-tests.py for consistency. 2021-03-12 19:56:09 +11:00
run-tests.py tests/run-tests.py: Parallelize running tests by default. 2021-05-14 11:33:31 +10:00

This directory contains tests for various functionality areas of MicroPython.
To run all stable tests, run "run-tests.py" script in this directory.

Tests of capabilities not supported on all platforms should be written
to check for the capability being present. If it is not, the test
should merely output 'SKIP' followed by the line terminator, and call
sys.exit() to raise SystemExit, instead of attempting to test the
missing capability. The testing framework (run-tests.py in this
directory, test_main.c in qemu_arm) recognizes this as a skipped test.

There are a few features for which this mechanism cannot be used to
condition a test. The run-tests.py script uses small scripts in the
feature_check directory to check whether each such feature is present,
and skips the relevant tests if not.

Tests are generally verified by running the test both in MicroPython and
in CPython and comparing the outputs. If the output differs the test fails
and the outputs are saved in a .out and a .exp file respectively.
For tests that cannot be run in CPython, for example because they use
the machine module, a .exp file can be provided next to the test's .py
file. A convenient way to generate that is to run the test, let it fail
(because CPython cannot run it) and then copy the .out file (but not
before checking it manually!)

When creating new tests, anything that relies on float support should go in the
float/ subdirectory.  Anything that relies on import x, where x is not a built-in
module, should go in the import/ subdirectory.