Skip to content

Commit a4fc334

Browse files
ibhatimihaic
authored andcommitted
Update documentation for split library (#410)
GitOrigin-RevId: c298f8879445bfe2e16c5f987594fe3474648f28
1 parent 07bb04a commit a4fc334

File tree

135 files changed

+20
-51791
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

135 files changed

+20
-51791
lines changed

CMakeLists.txt

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -78,10 +78,6 @@ if(SVS_BUILD_EXAMPLES)
7878
add_subdirectory(examples)
7979
endif()
8080

81-
if(SVS_BUILD_DOCS)
82-
add_subdirectory(docs)
83-
endif()
84-
8581
# The benchmark directory contains a sub-component that is used by both the benchmarking
8682
# framework and the unit-tests.
8783
#

README.md

Lines changed: 9 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
# Scalable Vector Search
22

33
**Scalable Vector Search (SVS)** is a performance library for vector [similarity search](https://en.wikipedia.org/wiki/Similarity_search).
4-
Thanks to the use of Locally-adaptive Vector Quantization [[ABHT23]](#1) and its highly optimized indexing and search algorithms,
4+
Thanks to the use of Locally-adaptive Vector Quantization (LVQ) [[ABHT23]](#1) and its highly optimized indexing and search algorithms,
55
SVS provides vector similarity search:
66
* on **billions** of **high-dimensional** vectors,
77
* at **high accuracy**
@@ -13,6 +13,8 @@ This enables application and framework developers using similarity search to unl
1313
SVS offers a fully-featured and yet simple Python API, compatible with most standard libraries.
1414
SVS is written in C++ to facilitate its integration into performance-critical applications.
1515

16+
**Please note** that this repository only contains the open-source portion of the SVS library, which supports all functionalities and features described [here](https://intel.github.io/ScalableVectorSearch/), except for our proprietary vector compression techniques, specifically LVQ [[ABHT23]](#1) and Leanvec [[TBAH24]](#2). These techniques are closed-source and supported exclusively on Intel hardware. We provide [shared library](https://github.com/intel/ScalableVectorSearch/releases) and [PyPI package](https://pypi.org/project/scalable-vs/) to enable these vector compression techniques in C++ and Python, respectively.
17+
1618
## Performance
1719

1820
SVS provides state-of-the-art performance and accuracy [[ABHT23]](#1) for billion-scale similarity search on
@@ -22,11 +24,11 @@ For example, for the standard billion-scale [Deep-1B](http://sites.skoltech.ru/c
2224
different configurations of SVS yield significantly increased performance (measured in queries per second, QPS) with a smaller memory footprint (horizontal axis) than the alternatives[^1]:
2325

2426
<p align="center">
25-
<img src="./docs/figs/SVS_performance_memoryfootprint.png" height=80% width=80%>
27+
<img src="./data/figs/SVS_performance_memoryfootprint.png" height=80% width=80%>
2628
</p>
2729

2830
SVS is primarily optimized for large-scale similarity search but it still offers [state-of-the-art performance
29-
at million-scale](https://intel.github.io/ScalableVectorSearch/benchs/small_scale_benchs.html).
31+
at million-scale](https://intel.github.io/ScalableVectorSearch/benchs/static/previous/small_scale_benchs.html).
3032

3133
Best performance is obtained with 4th generation (Sapphire Rapids) by making use of Intel(R) AVX-512 instructions,
3234
with excellent results also with 2nd and 3rd Intel &reg; Xeon &reg; processors (Cascade Lake
@@ -73,6 +75,10 @@ Reference to cite when you use SVS in a research paper:
7375
Aguerrebere, C.; Bhati I.; Hildebrand M.; Tepper M.; Willke T.:Similarity search in the blink of an eye with compressed
7476
indices. In: Proceedings of the VLDB Endowment, 16, 11, 3433 - 3446. (2023)
7577

78+
<a id="2">[TBAH24]</a>
79+
Tepper M.; Bhati I.; Aguerrebere, C.; Hildebrand M.; Willke T.:LeanVec: Searching vectors faster by making them fit.
80+
In: Transactions on Machine Learning Research(TMLR), ISSN, 2835 - 8856. (2024)
81+
7682
## Legal
7783
Refer to the [LICENSE file](LICENSE) for details.
7884

cmake/options.cmake

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -22,11 +22,6 @@ option(SVS_BUILD_TESTS
2222
OFF # disabled by default
2323
)
2424

25-
option(SVS_BUILD_DOCS
26-
"Build the library documentation."
27-
OFF # disabled by default
28-
)
29-
3025
option(SVS_BUILD_EXAMPLES
3126
"Build the examples. If combined with SVS_BUILD_TESTS, will also test the examples."
3227
OFF # disabled by default

data/serialization.toml

Lines changed: 0 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -151,22 +151,6 @@ schema_version = "v0.0.0"
151151
name = "str"
152152
visited_set = "bool"
153153

154-
# LeanVec
155-
[[schemas]]
156-
__schema__ = "leanvec_matrices"
157-
__version__ = "v0.0.0"
158-
data_matrix = "table"
159-
query_matrix = "table"
160-
161-
[[schemas]]
162-
__schema__ = "leanvec_dataset"
163-
__version__ = "v0.0.0"
164-
primary = "table"
165-
secondary = "table"
166-
matrices = "table"
167-
means = "array"
168-
is_pca = "bool"
169-
170154
##### SVS Benchmark
171155
[[schemas]]
172156
__schema__ = "benchmark_dynamic_schedule"

docs/CMakeLists.txt

Lines changed: 0 additions & 84 deletions
This file was deleted.

docs/_static/css/custom.css

Whitespace-only changes.

0 commit comments

Comments
 (0)