Worklog for task "Research qualitative programmatic human voice synthesis in the browser"

Clarification on the Search for Existing Implementations

The search for external projects was primarily needed to answer one question:

to what extent the space of real human speech lies within the space of sounds that a compact procedural generator can reproduce.

Direct confirmation of this has not yet been found.

What is Known for Certain

AudioContext is capable of high-quality reproduction of any pre-recorded digital sound if given the full array of samples. This means the problem is not the browser as a playback environment.

The problem is representation.

A full waveform is universal, but expensive: even a heavily compressed second of speech remains a sequence of thousands of values. Our model replaces this sequence with a compact script of meaningful parameters and commands over time.

Therefore, the boundary under investigation looks like this:

full waveform ← more data / higher universality ... structural VoiceScenario → less data / higher controllability

We need to understand where on this axis the quality sufficient for natural speech appears.

Why the Found Projects Did Not Provide an Answer

Pink Trombone and similar physical models show that it is possible to procedurally generate a portion of the voice-like space, but:

• they are not universal;
• they mostly demonstrate vowel-like states and limited articulation;
• the sound remains computer-generated;
• there is no full demonstration of syllables and high-quality connected speech;
• there is no inverse decoder recording → compact script.

Formant demos are even narrower: they show individual static or near-static sounds, but do not answer the question of covering real speech.

Klatt-like systems are not a benchmark for our architecture because they already rely on phonemic/language presets and do not solve the universal decoding of arbitrary sound.

Neural TTS/codec systems demonstrate high quality, but hide the internal representation and do not provide a transparent, controllable script that can be explored and edited.

New Conclusion

The absence of a found example does not mean that a compact script-based generator is incapable of approaching human speech. It only means that we do not yet have external proof of the required quality level.

Therefore, the next practical path is not to continue an endless search for analogues, but to measure the limits of our own model:

1. improve the direct generator;
2. build a visual script editor to speed up manual tuning;
3. create an inverse decoder and first test it on our own synthetic data with known ground truth;
4. then transfer it to human recordings;
5. gradually increase the expressiveness of the representation and measure the quality gain provided by each additional mechanism.

The main object of research now is the tradeoff between the compactness of the structural description and perceptual quality.