Task: Create VoiceScenario Visual Editor and Human ↔ AI Loop

Goal

Create a visual editor for synthesizer scenarios to stop editing code for every iteration and shift the work to the VoiceScenario level itself.

What the editor should be able to do

• load an existing scenario JSON;
• create a scenario from scratch;
• edit the initial state;
• edit common timeline commands (set, animate, and other supported operations);
• change durations, levels, frequencies, noise parameters, resonances, and other available parameters;
• play the result immediately after modification;
• save and export the modified JSON;
• quickly switch between variants.

Human as Perceptual Validator

The quality of the result is still most reliably evaluated by ear. Therefore, the editor should minimize the cycle:

change parameters → play → hear result → change again.

The goal is to remove mandatory AI source code editing from this cycle.

Automation via AI Agent

The next layer of the editor:

1. a human uploads/records a reference sound;
2. the system receives its analytical log;
3. the current VoiceScenario is played and its log is built;
4. upon clicking a button, both logs along with the current JSON are sent to the AI agent;
5. the agent compares them and returns the modified scenario JSON;
6. the editor applies the variant;
7. the human checks it by ear.

The AI is not the final judge of quality here — it helps search for changes in the structured parameter space, while the human remains the perceptual quality validator.

Separately Check Log Quality

There is a hypothesis that current analytical logs are compressed too much and lose features that a human can hear. It is necessary to be able to increase the analysis resolution and compare whether this improves the AI's ability to suggest useful changes.

Important Research Mode

Do not discard accidentally discovered useful sounds.

If searching for Ha results in a recognizable Va or another desired voice fragment:

• save the scenario as a separate result;
• save both original and modified variants;
• record which parameter changes led to the transition;
• use this as knowledge about the structure of the parametric space.

Success Criterion

The editor should make sound iterations significantly cheaper: a human is able to independently change and test scenarios, and the AI works with JSON/logs instead of constantly modifying code.