Context as a limiting factor and vendor lock-in
Language Models like ChatGPT require careful consideration of context length for optimal performance. Two strategies are available: small context or long context, each with their pros and cons. Developers must choose based on project requirements and stage of development, balancing technical feasibility with business value.