ContextQMD
Back to Baml

02 Status

beps/docs/proposals/BEP-005-prompt-optimization/02_status.md

0.222.01.5 KB
Original Source
  • typos (promp)
  • [-] Consider better name than --reset-gepa-prompts (won't do)
  • Needs a link to GEPA
  • Link to DSPy
  • Include (at least a snippet of) gepa.baml
  • [-] Future thing: bash autocomplete would be nice (won't do)
  • Concrete example for --resume
  • Make sure these commands work whether you're in user's baml_src or in .baml_optimize
  • [-] Add a cool visualization. Either a final image or a live TUI (won't do)
  • Add limitations section (no type modifications, no template_strings)
  • Inline examples into cli option help text
  • Does --help show defaults?
  • If there's custom gepa.baml changes, warn before erasing
  • [-] Future: baml.toml includes the optimization args
  • [-] gepa.baml versioning will be an issue in the future. No clear solution now (noted)
  • Copy some of these notes into BEP for tracking
  • follow_links - is it recursive? (It's just a builder method on a WalkDir. Only recursive if the user make a loop with symlinks.
  • Use some crate for rendering diffs (we use the same lib)
  • failure_location - see if we have an enum that gives us error
  • limitations: 500 from LLM provider might unfairly penalize the prompt candidate.
  • Write "ctx.output_format writes the schema, so you don't have to write the schema".
  • We need to improve gepa.baml to teach it how to use jinja
  • Give gepa.baml more info about the parameters of ctx.output_format
  • Block on TODO extract descriptions and aliases