Skip to main content
小龙虾小龙虾AI
🤖

向量嵌入

生成、存储和搜索向量嵌入,支持选择提供商、分块策略和相似性搜索优化。

下载1.5k
星标2
版本1.0.0
搜索研究
安全通过

技能说明


name: Embeddings slug: embeddings description: Generate, store, and search vector embeddings with provider selection, chunking strategies, and similarity search optimization.

When to Use

User wants to convert text/images to vectors, build semantic search, or integrate embeddings into applications.

Quick Reference

TopicFile
Provider comparison & selectionproviders.md
Chunking strategies & codechunking.md
Vector database patternsstorage.md
Search & retrieval tuningsearch.md

Core Capabilities

  1. Generate embeddings — Call provider APIs (OpenAI, Cohere, Voyage, local models)
  2. Chunk content — Split documents with overlap, semantic boundaries, token limits
  3. Store vectors — Insert into Pinecone, Weaviate, Qdrant, pgvector, Chroma
  4. Similarity search — Query with top-k, filters, hybrid search
  5. Batch processing — Handle large datasets with rate limiting and retries
  6. Model comparison — Evaluate embedding quality for specific use cases

Decision Checklist

Before recommending approach, ask:

  • What content type? (text, code, images, multimodal)
  • Volume and update frequency?
  • Latency requirements? (real-time vs batch)
  • Budget constraints? (API costs vs self-hosted)
  • Existing infrastructure? (cloud provider, database)

Critical Rules

  • Same model everywhere — Query embeddings MUST use identical model as document embeddings
  • Normalize before storage — Most similarity metrics assume unit vectors
  • Chunk with overlap — 10-20% overlap prevents context loss at boundaries
  • Batch API calls — Never embed one item at a time in production
  • Cache embeddings — Regenerating is expensive; store with source hash
  • Monitor dimensions — Higher isn't always better; 768-1536 is usually optimal

Provider Quick Selection

NeedProviderWhy
Best quality, any costOpenAI text-embedding-3-largeTop benchmarks
Cost-sensitiveOpenAI text-embedding-3-small5x cheaper, 80% quality
MultilingualCohere embed-multilingual-v3100+ languages
Code/technicalVoyage voyage-code-2Optimized for code
Privacy/offlineLocal (e5, bge, nomic)No data leaves machine
ImagesOpenAI CLIP, Cohere multimodalCross-modal search

Common Patterns

# Batch embedding with retry
def embed_batch(texts, model="text-embedding-3-small"):
    results = []
    for chunk in batched(texts, 100):  # API limit
        response = client.embeddings.create(input=chunk, model=model)
        results.extend([e.embedding for e in response.data])
    return results

# Similarity search with filter
results = index.query(
    vector=query_embedding,
    top_k=10,
    filter={"category": "technical"},
    include_metadata=True
)

如何使用「向量嵌入」?

  1. 打开小龙虾AI(Web 或 iOS App)
  2. 点击上方「立即使用」按钮,或在对话框中输入任务描述
  3. 小龙虾AI 会自动匹配并调用「向量嵌入技能完成任务
  4. 结果即时呈现,支持继续对话优化

相关技能