Skip to content
Skillpedia
Databases40k · #5298

qdrant-model-migration

Lets your agent migrate data models in Qdrant without interruptions. It helps switch or update vector models without stopping the service.

What it does

This guide helps you switch the embedding model (how your data is turned into numbers for searching) in Qdrant without service interruption. It explains how to migrate your data to a new model without your application going offline.

When to use it

  • ✓When you want to change the model that turns text into numbers.
  • ✓When you need to update your data for a new model without downtime.
  • ✓When you want to test a new model against the old one.

Example of what to ask your AI

“How can I switch my embedding model in Qdrant without downtime?”

Want more? Open the sections below.

How to use

The easiest way: copy the message below and paste it into Claude, ChatGPT, Cursor or any AI. It reads the skill and follows the instructions.

Skill link

https://github.com/github/awesome-copilot/blob/main/skills/qdrant-model-migration/SKILL.md

Ready-to-paste message

Use this skill to help me: https://github.com/github/awesome-copilot/blob/main/skills/qdrant-model-migration/SKILL.md Read the SKILL.md file at that link and follow its instructions for my task.
How it works

Qdrant doesn't allow adding new types of 'vectors' (the numbers representing your data) to an existing collection. Therefore, you need to create a new collection and migrate the data. To avoid downtime, you can use 'aliases' (collection nicknames) to switch collections seamlessly.

Installation

Easiest way: copy the skill link and paste it into Claude, ChatGPT or Cursor asking it to follow the instructions.

In the terminal (Claude Code, Codex, Cursor), in your project folder:

npx skills add github/awesome-copilot --skill qdrant-model-migration

Or download just the file:

curl -L https://raw.githubusercontent.com/github/awesome-copilot/main/skills/qdrant-model-migration/SKILL.md -o SKILL.md
Technical content (original SKILL.md)

Original text by the author, straight from GitHub.

What to Do When Changing Embedding Models

Vectors from different models are incompatible. You cannot mix old and new embeddings in the same vector space. You also cannot add new named vector fields to an existing collection. All named vectors must be defined at collection creation time. Both migration strategies below require creating a new collection.

Can I Avoid Re-embedding?

Use when: looking for shortcuts before committing to full migration.

You MUST re-embed if: changing model provider (OpenAI to Cohere), changing architecture (CLIP to BGE), incompatible dimension counts across different models, or adding sparse vectors to dense-only collection.

You CAN avoid re-embedding if: using Matryoshka models (use dimensions parameter to output lower-dimensional embeddings, learn linear transformation from sample data, some recall loss, good for 100M+ datasets). Or changing quantization (binary to scalar): Qdrant re-quantizes automatically. Quantization

Need Zero Downtime (Alias Swap)

Use when: production must stay available. Recommended for model replacement at scale.

  • Create a new collection with the new model's dimensions and distance metric
  • Re-embed all data into the new collection in the background
  • Point your application at a collection alias instead of a direct collection name
  • Atomically swap the alias to the new collection Switch collection
  • Verify search quality, then delete the old collection

Careful, the alias swap only redirects queries. Payloads must be re-uploaded separately.

Need Both Models Live (Side-by-Side)

Use when: A/B testing models, multi-modal (dense + sparse), or evaluating a new model before committing.

You cannot add a named vector to an existing collection. Create a new collection with both vector fields defined upfront:

  • Create new collection with old and new named vectors both defined Collection with multiple vectors
  • Migrate data from old collection, preserving existing vectors in the old named field
  • Backfill new model embeddings incrementally using UpdateVectors Update vectors
  • Compare quality by querying with using: "old_model" vs using: "new_model"
  • Swap alias to new collection once satisfied

Co-locating large multi-vectors (especially ColBERT) with dense vectors degrades ALL queries, even those only using dense. At millions of points, users report 13s latency dropping to 2s after removing ColBERT. Put large vectors on disk during side-by-side migration.

If you anticipate future model migrations, define both vector fields upfront at collection creation.

Dense to Hybrid Search Migration

Use when: adding sparse/BM25 vectors to an existing dense-only collection. Most common migration pattern.

You cannot add sparse vectors to an existing dense-only collection. Must recreate:

  • Create new collection with both dense and sparse vector configs defined
  • Re-embed all data with both dense and sparse models
  • Migrate payloads, swap alias

Sparse vectors at chunk level have different TF-IDF characteristics than document level. Test retrieval quality after migration, especially for non-English text without stop-word removal.

Re-embedding Is Too Slow

Use when: dataset is large and re-embedding is the bottleneck.

  • Use update_mode: insert (v1.17+) for safe idempotent migration Update mode
  • Scroll the old collection with with_vectors=False, re-embed in batches, upsert into new collection
  • Upload in parallel batches (64-256 points per request, 2-4 parallel streams) Bulk upload
  • Disable HNSW during bulk load (set indexing_threshold_kb very high, restore after)
  • For Qdrant Cloud inference, switching models is a config change, not a pipeline change Inference docs

…

FAQ

Do I need to re-embed all my data?

Yes, in most cases. If you change the model provider (e.g., from OpenAI to Cohere), the model architecture, or the dimensions of the generated numbers, you'll need to re-embed your data. Minor changes like the 'quantization' method (compressing numbers) might be handled automatically.

What are collection aliases?

Aliases are like nicknames for your data collections. Instead of your application always pointing to the exact collection name, it points to an alias. This allows you to switch the alias to point to a new collection without changing your application's code.

What if my data is very large?

For very large datasets, re-embedding everything can be slow. The guide suggests optimizations like temporarily disabling HNSW indexing and performing parallel batch uploads to speed up the process.

Details

Original description by the author

Guides embedding model migration in Qdrant without downtime. Use when someone asks 'how to switch embedding models', 'how to migrate vectors', 'how to update to a new model', 'zero-downtime model change', 'how to re-embed my data', or 'can I use two models at once'. Also use when upgrading model dimensions, switching providers, or A/B testing models.

repo: github/awesome-copilot

Popularity

GitHub stars
40k
Ranking position
#5298
License
MIT
Updated
10/15/2026

Is this skill useful?

0

Sign in to vote.

Comments

  • …

More skills from this repository

Similar skills