Skip to content

Model Selection Strategy

Choosing the right model for your use case can significantly impact both performance and cost.

Recommendations:

  • Start with smaller models - Begin development with models like deepseek-ai/DeepSeek-PL-7B or openbmb/MiniCPM3-4B which offer faster response times and lower costs.
  • Test before committing - Evaluate 2-3 models on your specific tasks before selecting one for production.
  • Match model to task - Use specialized models for specialized tasks:
    • Mathematical reasoning: deepseek-ai/DeepSeek-Math or bespokelabs/Bespoke-Stratos-32B
    • Multilingual content: CohereForAI/aya-expanse-32b or tiiuae/Falcon3-10B-Instruct
    • Document processing: jinaai/ReaderLM-v2
  • Consider context length needs - Only pay for extended context when your application requires it.