Commit Graph

312 Commits

Author SHA1 Message Date
Magnus Müller 7fb8e5b39b feat: implement SDK-native rate limiting for improved reliability
- Increase max_retries to 10 for all LLM providers (was 2-3)
- OpenAI: Use built-in retry with exponential backoff, jitter, Retry-After header support
- Anthropic: Use built-in retry with intelligent error classification
- Groq: Use built-in retry with capacity exceeded handling (498 errors)
- Google: Implement custom retry logic with pattern-based error detection
- Azure: Inherits improved retry from OpenAI base class

Benefits:
- More resilient to temporary API issues during automation
- Leverages provider SDKs' optimized retry logic
- Reduces custom retry code maintenance burden
- Automatically handles provider-specific error patterns

All providers now retry rate limits, server errors, and connection issues
while skipping authentication errors and bad requests.
2025-06-26 18:08:51 +02:00
Gregor Žunič 2ee526d903 updated pricing for cached tokens support 2025-06-25 15:33:47 +02:00
Gregor Žunič 76dde6d520 remvoed unnecesary asset, thanks Cubic 2025-06-25 11:08:15 +02:00
Gregor Žunič bf9ea1e33a fallback parser for groq 2025-06-25 10:53:27 +02:00
Gregor Žunič 160d0160fb small fixes 2025-06-24 14:20:15 +02:00
Gregor Žunič 514b207e8f removed confusing docstrings 2025-06-24 14:13:41 +02:00
Gregor Žunič 7a3f8ad4de removed unnecesary llms 2025-06-24 14:08:40 +02:00
Gregor Žunič aa13091312 fixed groq type error 2025-06-24 13:27:53 +02:00
Gregor Žunič f2fc8a357e removed unused _serialize_tool_content for groq and openai serializer 2025-06-24 12:49:25 +02:00
Gregor Žunič 737c292e75 removed save image google serializer 2025-06-24 12:46:00 +02:00
Gregor Žunič 7538a68df8 added Generic support for python 3.11 2025-06-24 12:42:30 +02:00
Gregor Žunič 7a10ae0c96 Squashed commit langchain to native 2025-06-24 12:26:55 +02:00