Otherwise, a lot of frames were being dropped, leading to a low framerate in the "directio" demo for OV5640 cameras
This is in preparation for ESP32-S3 support and potentially others. Related to #4363