Compiler From Scratch: Phase 1 - Tokenizer Generator 016: Testing all build permutations

Streamed on 2024-11-01 (https://www.twitch.tv/thediscouragerofhesitancy)

Zero Dependencies Programming!

With so many build options defined in #define in the generated Tokenizer code, it behooves me to automatically test the permutations. So a python script I did begin to write. The flow looks something like the following:
- The Tokenizer Generator is built as vv.exe
- For every file encoding supported, a new configuration is generated
- For every combination of build options, the configuration is used to generate a new Tokenizer
- Each new Tokenizer is built and tested against a pre-defined test case appropriate for the supported file encoding.

In the process of building this script I found some issues already that I will have to address before I can finish the script, but that is the whole point: exercise all the code paths.