Rewrite new simulator to use JSON mode; additional fixes to new simulator#34

Open

hijohnnylin wants to merge 14 commits intoopenai:mainfrom

hijohnnylin:simulator_edge_cases

Commits on Dec 30, 2023

Fix bug with last activation values
hijohnnylin
committed
Further fix edge case 3 to set correct start_line_index when first token is <|endoftext|>, and also fix bug when activation is outside of expected range of 0 to 10
hijohnnylin
committed
Add debug logging
hijohnnylin
committed

Commits on Dec 31, 2023

Commits on Jan 5, 2024

Rewrite new scorer with JSON mode. Add temperature = 0.
hijohnnylin
committed

Commits on Jan 6, 2024

Fix: Catch incorrect type of activation value in JSON response
hijohnnylin
committed

Commits on Jan 8, 2024

Increase max_tokens to 2000, move endoftext and non-ascii handling out of simulator (should be handled by preprocessing outside of library in case GPT bugs are fixed), add better debug logging
hijohnnylin
committed

Commits on Jan 10, 2024

more detailed error logging for easier debugging of invalid GPT responses
hijohnnylin
committed

Commits on Feb 14, 2024

ENHANCEMENT: Fine-tuned scorer: Update prompt, add new examples
hijohnnylin
committed