AI Focus Groups

Given an objective, tests message wordings to achieve it. Evolves messaging based on feedback. Edit application.yml to change maxIterations and other config to determine how it behaves.

Set maxIterations to 1 to evaluate the messages passed in, rather than attempt to evolve them. This will ensure negligible cost.

Running

Running this will cost money. Out of the box expect ~ 10c per run. If you enlarge the participant matrix or evaluate longer deliverables this will increase.

Set your OpenAI and Anthropic API keys. The environment variables are:

• OPENAI_API_KEY
• ANTHROPIC_API_KEY

To use local models or other providers, change application.yml to reference different models.

Run the shell script to start Embabel under Spring Shell:

./scripts/shell.sh

Then run the following command:

focus-group --message smoking --group english_teen

Messaging files are loaded under src/data/messages. The default is smoking.yml. Participant files are loaded under src/data/participants. The english_teen.yml file shows the format. Use your own base name.

These files show the required format.

See application.yml for other configuration. This file also controls the creative personas that will attempt to evolve the messaging.

Also in application.yml, you should probably raise maxIterations to at least 10 to give the agent the chance to optimize the messaging.