Gemini 3.1 Flash Lite Goes GA: The Sweet Spot for High-Throughput Agents & Low-Latency Workloads

Documentation Index

Fetch the complete documentation index at: https://docs.apiyi.com/llms.txt

Use this file to discover all available pages before exploring further.

​

Key Highlights

• Now Generally Available: Google announced GA for Gemini 3.1 Flash Lite on May 8, 2026 (UTC+8) — production-ready
• Model Identifier Updated: gemini-3.1-flash-lite-preview → gemini-3.1-flash-lite. Preview users should plan migration
• Massive Speed Boost: 64% faster output than 2.5 Flash (381.9 vs 232.3 tokens/sec) and 2.5× faster time-to-first-token
• Official Pricing Parity: $0.25 per 1M input / $1.50 per 1M output — identical to Google’s official rates
• Stackable Top-up Promo: APIYi top-up bonuses bring effective price down to 79–85% of list (up to 21% off)

​

Background

​

Detailed Analysis

​

What changed from Preview to GA

​

Performance highlights (GA benchmarks)

​

Technical specs

​

Real-World Use Cases

​

Recommended scenarios

​

Code examples

import openai

client = openai.OpenAI(
    api_key="your-apiyi-api-key",
    base_url="https://api.apiyi.com/v1"
)

response = client.chat.completions.create(
    model="gemini-3.1-flash-lite",  # GA, no -preview suffix
    messages=[
        {"role": "system", "content": "You are an efficient structured-data extraction assistant."},
        {"role": "user", "content": "Extract order_id, amount, and currency from the order text. Return JSON."}
    ],
    temperature=0.2,
    response_format={"type": "json_object"}
)

print(response.choices[0].message.content)

tools = [{
    "type": "function",
    "function": {
        "name": "search_internal_kb",
        "description": "Search the internal knowledge base",
        "parameters": {
            "type": "object",
            "properties": {
                "query": {"type": "string"},
                "top_k": {"type": "integer", "default": 5}
            },
            "required": ["query"]
        }
    }
}]

resp = client.chat.completions.create(
    model="gemini-3.1-flash-lite",
    messages=[{"role": "user", "content": "Find docs about the refund process."}],
    tools=tools,
    tool_choice="auto"
)
print(resp.choices[0].message.tool_calls)

​

Best practices

​

Pricing & Availability

​

APIYi official-direct pricing

​

Stackable top-up promotion (79–85% of list)

​

Summary & Recommendations

• 64% faster output / 2.5× faster TTFT vs 2.5 Flash — visibly snappier on long agent loops
• GPQA Diamond 86.9% / MMMU Pro 76.8% — first-tier on reasoning and multimodal at this price
• $0.25 / $1.50 per 1M tokens, plus APIYi top-up promo down to ~79% of list
• Stable contract post-GA — production-ready

• Teams on Preview: cut over to the GA model name to lock in a stable contract
• High-volume agent teams: route routing / tool-calling / extraction nodes through Flash Lite; combine with Batch + Cache to drive unit cost to the floor
• Multimodal lightweight teams: cover text, image, video, audio, PDF with one model — less SDK sprawl