Completion Service Selection Strategy

Context and Problem Statement

Today, SK uses the current IAIServiceSelector implementation to determine which type of service is used when running a text prompt. The IAIServiceSelector implementation will return either a chat completion service, text generation service or it could return a service that implements both. The prompt will be run using chat completion by default and falls back to text generation as the alternate option.

The behavior supersedes that description in ADR-0015

Decision Drivers

• Chat completion services are becoming dominant in the industry e.g. OpenAI has deprecated most of it's text generation services.
• Chat completion generally provides better responses and the ability to use advanced features e.g. tool calling.

Decision Outcome

Chosen option: Keep the current behavior as described above.