KansaiGaijin/Homelab
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
d220b04e32f8dd082b59375c28617d0541548868
Homelab/Development/litellm/docs/my-website/release_notes/v1.74.7/index.md

18 KiB
Raw Blame History

title, slug, date, authors, hide_table_of_contents
title slug date authors hide_table_of_contents
v1.74.7-stable v1-74-7 2025-07-19T10:00:00
name title url image_url
Krrish Dholakia CEO, LiteLLM https://www.linkedin.com/in/krish-d/ https://pbs.twimg.com/profile_images/1298587542745358340/DZv3Oj-h_400x400.jpg
name title url image_url
Ishaan Jaffer CTO, LiteLLM https://www.linkedin.com/in/reffajnaahsi/ https://pbs.twimg.com/profile_images/1613813310264340481/lz54oEiB_400x400.jpg
false

import Image from '@theme/IdealImage'; import Tabs from '@theme/Tabs'; import TabItem from '@theme/TabItem';

Deploy this version

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:v1.74.7-stable.patch.1

pip install litellm==1.74.7.post2

Key Highlights

  • Vector Stores - Support for Vertex RAG Engine, PG Vector, OpenAI & Azure OpenAI Vector Stores.
  • Bulk Editing Users - Bulk editing users on the UI.
  • Health Check Improvements - Prevent unnecessary pod restarts during high traffic.
  • New LLM Providers - Added Moonshot AI and Vercel v0 provider support.

Vector Stores API

<Image img={require('../../img/release_notes/vector_stores.png')} />

This release introduces support for using VertexAI RAG Engine, PG Vector, Bedrock Knowledge Bases, and OpenAI Vector Stores with LiteLLM.

This is ideal for use cases requiring external knowledge sources with LLMs.

This brings the following benefits for LiteLLM users:

Proxy Admin Benefits:

  • Fine-grained access control: determine which Keys and Teams can access specific Vector Stores
  • Complete usage tracking and monitoring across all vector store operations

Developer Benefits:

  • Simple, unified interface for querying vector stores and using them with LLM API requests
  • Consistent API experience across all supported vector store providers

Get started

Bulk Editing Users

<Image img={require('../../img/bulk_edit_graphic.png')} />

v1.74.7-stable introduces Bulk Editing Users on the UI. This is useful for:

  • granting all existing users to a default team (useful for controlling access / tracking spend by team)
  • controlling personal model access for existing users

Read more

Health Check Server

<Image alt="Separate Health App Architecture" img={require('../../img/separate_health_app_architecture.png')} style={{ borderRadius: '8px', marginBottom: '1em', maxWidth: '100%' }} />

This release brings reliability improvements that prevent unnecessary pod restarts during high traffic. Previously, when the main LiteLLM app was busy serving traffic, health endpoints would timeout even when pods were healthy.

Starting with this release, you can run health endpoints on an isolated process with a dedicated port. This ensures liveness and readiness probes remain responsive even when the main LiteLLM app is under heavy load.

Read More

New Models / Updated Models

Pricing / Context Window Updates

Provider Model Context Window Input ($/1M tokens) Output ($/1M tokens)
Azure AI azure_ai/grok-3 131k $3.30 $16.50
Azure AI azure_ai/global/grok-3 131k $3.00 $15.00
Azure AI azure_ai/global/grok-3-mini 131k $0.25 $1.27
Azure AI azure_ai/grok-3-mini 131k $0.275 $1.38
Azure AI azure_ai/jais-30b-chat 8k $3200 $9710
Groq groq/moonshotai-kimi-k2-instruct 131k $1.00 $3.00
AI21 jamba-large-1.7 256k $2.00 $8.00
AI21 jamba-mini-1.7 256k $0.20 $0.40
Together.ai together_ai/moonshotai/Kimi-K2-Instruct 131k $1.00 $3.00
v0 v0/v0-1.0-md 128k $3.00 $15.00
v0 v0/v0-1.5-md 128k $3.00 $15.00
v0 v0/v0-1.5-lg 512k $15.00 $75.00
Moonshot moonshot/moonshot-v1-8k 8k $0.20 $2.00
Moonshot moonshot/moonshot-v1-32k 32k $1.00 $3.00
Moonshot moonshot/moonshot-v1-128k 131k $2.00 $5.00
Moonshot moonshot/moonshot-v1-auto 131k $2.00 $5.00
Moonshot moonshot/kimi-k2-0711-preview 131k $0.60 $2.50
Moonshot moonshot/moonshot-v1-32k-0430 32k $1.00 $3.00
Moonshot moonshot/moonshot-v1-128k-0430 131k $2.00 $5.00
Moonshot moonshot/moonshot-v1-8k-0430 8k $0.20 $2.00
Moonshot moonshot/kimi-latest 131k $2.00 $5.00
Moonshot moonshot/kimi-latest-8k 8k $0.20 $2.00
Moonshot moonshot/kimi-latest-32k 32k $1.00 $3.00
Moonshot moonshot/kimi-latest-128k 131k $2.00 $5.00
Moonshot moonshot/kimi-thinking-preview 131k $30.00 $30.00
Moonshot moonshot/moonshot-v1-8k-vision-preview 8k $0.20 $2.00
Moonshot moonshot/moonshot-v1-32k-vision-preview 32k $1.00 $3.00
Moonshot moonshot/moonshot-v1-128k-vision-preview 131k $2.00 $5.00

Features

Bugs

LLM API Endpoints

Features

Bugs

MCP Gateway

Features

Bugs

- Fix to update object permission on update/delete key/team - [PR #12701](https://github.com/BerriAI/litellm/pull/12701)
- Include /mcp in list of available routes on proxy - [PR #12612](https://github.com/BerriAI/litellm/pull/12612)

Management Endpoints / UI

Features

  • Keys
    • Regenerate Key State Management improvements - PR #12729
  • Models
    • Wildcard model filter support - PR #12597
    • Fixes for handling team only models on UI - PR #12632
  • Usage Page
    • Fix Y-axis labels overlap on Spend per Tag chart - PR #12754
  • Teams
    • Allow setting custom key duration + show key creation stats - PR #12722
    • Enable team admins to update member roles - PR #12629
  • Users
  • Logs Page
    • Add end_user filter on UI Logs Page - PR #12663
  • MCP Servers
    • Copy MCP Server name functionality - PR #12760
  • Vector Stores
    • UI support for clicking into Vector Stores - PR #12741
    • Allow adding Vertex RAG Engine, OpenAI, Azure through UI - PR #12752
  • General
    • Add Copy-on-Click for all IDs (Key, Team, Organization, MCP Server) - PR #12615
  • SCIM
    • Add GET /ServiceProviderConfig endpoint - PR #12664

Bugs

  • Teams
    • Ensure user id correctly added when creating new teams - PR #12719
    • Fixes for handling team-only models on UI - PR #12632

Logging / Guardrail Integrations

Features

Bugs

Performance / Loadbalancing / Reliability improvements

Features

  • Health Checks
    • Separate health app for liveness probes - PR #12669
    • Health check app on separate port - PR #12718
  • Caching
  • Router
    • Handle ZeroDivisionError with zero completion tokens in lowest_latency strategy - PR #12734

Bugs

  • Database
    • Use upsert for managed object table to avoid UniqueViolationError - PR #11795
    • Refactor to support use_prisma_migrate for helm hook - PR #12600
  • Cache
    • Fix: redis caching for embedding response models - PR #12750

Helm Chart

  • DB Migration Hook: refactor to support use_prisma_migrate - for helm hook PR
  • Add envVars and extraEnvVars support to Helm migrations job - PR #12591

General Proxy Improvements

Features

  • Control Plane + Data Plane Architecture
    • Control Plane + Data Plane support - PR #12601
  • Proxy CLI
    • Add "keys import" command to CLI - PR #12620
  • Swagger Documentation
    • Add swagger docs for LiteLLM /chat/completions, /embeddings, /responses - PR #12618
  • Dependencies
    • Loosen rich version from ==13.7.1 to >=13.7.1 - PR #12704

Bugs

  • Verbose log is enabled by default fix - PR #12596

  • Add support for disabling callbacks in request body - PR #12762

  • Handle circular references in spend tracking metadata JSON serialization - PR #12643

New Contributors

Full Changelog