Scaling Vector Search in Distributed Databases: The YDB Journey

This presentation will explore the evolution of YDB, a distributed database, as it developed vector search capabilities. We'll discuss our journey from implementing a basic exact search to creating a global index system, designed to scale seamlessly across thousands of nodes and efficiently store and manage billions of vectors.

• Understand the stages of developing vector search capabilities in a distributed database, from initial implementations to sophisticated search indices.

• Gain insights into the technical challenges encountered in scaling vector search across thousands of nodes and what solutions were employed to overcome these barriers.

• Learn about the innovative indexing techniques used to support efficient and effective vector search, capable of handling billions of data points.

• Discover strategies and methods used to optimize the performance of vector search in distributed database environments.