存储、索引和管理由深度神经网络和其他机器学习 (ML) 模型生成的海量嵌入向量数据库。

Bingyi Sun 29d2c0bd7b Move task merge cap to config file (#19387) 1 day ago
.github 428840178c Support diskann index for vector field (#19093) 3 days ago
api 662c654fe3 Add the `context` param for the `hook` interceptor (#19405) 1 day ago
build 428840178c Support diskann index for vector field (#19093) 3 days ago
ci 4ef95b6ccb Increase nightly master running time (#19295) 4 days ago
cmd 928a213e31 Fix Chunk Manager Path mis use (#19141) 2 days ago
configs 29d2c0bd7b Move task merge cap to config file (#19387) 1 day ago
deployments c9195c56a3 [skip e2e] Change milvus dashboard datasource uid (#19395) 2 days ago
docs e40061b864 Update binlog event format (#18347) 1 month ago
githooks 12f50cb22c [skip ci]Update OWNERS files (#11898) 10 months ago
internal 29d2c0bd7b Move task merge cap to config file (#19387) 1 day ago
pkg a3a29fed06 Add entry point for embedded Milvus. (#16008) 6 months ago
scripts 22477d4601 UnWatch channels if failed to create collection (#19390) 2 days ago
tests 5f02f0975c Fix L2 string case logic (#19369) 2 days ago
tools aab060aeff upgrade Go 1.18 in go.mod (#18165) 1 month ago
.clang-format a77dd1034c Adopt the extended state in DataCoord (#16200) 6 months ago
.clang-tidy c35079d7e7 Update registerNode in indexservice 1 year ago
.clang-tidy-ignore a13638b172 Add cpplint and optimize the check of c++ code 1 year ago
.contributors 9a5b23fa4f [skip ci]Update all-contributors (#6358) 1 year ago
.devcontainer.json da628863bc Update main.yaml for Github Action (#6381) 1 year ago
.env d8b11121a8 Decrease build time by removing compiling openblas (#19207) 1 week ago
.gitignore 4de1bfe5bc Add cpp data codec (#18538) 2 weeks ago
.golangci.yml aab060aeff upgrade Go 1.18 in go.mod (#18165) 1 month ago
CODE_OF_CONDUCT.md 3655792fac [skip ci]Format markdown doc for CODE_OF_CONDUCT.md (#10042) 11 months ago
CODE_REVIEW.md 531a51bd75 [skip e2e]Fix a grammar issue (#15086) 8 months ago
COMMAND_HELP.md 91ab8373b3 Update docs for run-cpu-e2e (#18520) 1 month ago
COMMITTERS 8a708112eb [skip e2e] Update committer/maintainer list (#15875) 6 months ago
CONTRIBUTING.md 77d06bd071 [skip ci]Fix a minor mistake (#16966) 4 months ago
DEVELOPMENT.md aab060aeff upgrade Go 1.18 in go.mod (#18165) 1 month ago
LICENSE 0d4daa22e0 Update README 1 year ago
MAINTAINERS c173ad19a7 Update account (#17304) 3 months ago
Makefile 253fb514bd Add Revert in DataCoord meta catalog (#19313) 2 days ago
OWNERS 91554e3548 [skip ci]Add GitHub label for compilation changes (#12894) 9 months ago
OWNERS_ALIASES c173ad19a7 Update account (#17304) 3 months ago
README.md 9d508dfa49 Update all contributors 3 days ago
README_CN.md 9d508dfa49 Update all contributors 3 days ago
codecov.yml 11b352c3ae Guarantee flushed segments are all indexed (#19062) 1 week ago
docker-compose.yml 428840178c Support diskann index for vector field (#19093) 3 days ago
go.mod d7f38a803d Separate some proto files (#19218) 1 week ago
go.sum d7f38a803d Separate some proto files (#19218) 1 week ago
milvus20vs1x.md a1dfcba460 [skip e2e] Update milvus20vs1x.md (#15636) 7 months ago
rules.go 626854cf0c Refactor QueryCoord (#18836) 1 week ago

README.md

milvus banner

What is Milvus?

milvus-logo

Milvus is an open-source vector database built to power embedding similarity search and AI applications. Milvus makes unstructured data search more accessible, and provides a consistent user experience regardless of the deployment environment.

Milvus 2.0 is a cloud-native vector database with storage and computation separated by design. All components in this refactored version of Milvus are stateless to enhance elasticity and flexibility. For more architecture details, see Milvus Architecture Overview.

Milvus was released under the open-source Apache License 2.0 in October 2019. It is currently a graduate project under LF AI & Data Foundation.

Key features

Millisecond search on trillion vector datasets Average latency measured in milliseconds on trillion vector datasets.

Simplified unstructured data management
  • Rich APIs designed for data science workflows.
  • Consistent user experience across laptop, local cluster, and cloud.
  • Embed real-time search and analytics into virtually any application.
  • Reliable, always on vector database Milvus’ built-in replication and failover/failback features ensure data and applications can maintain business continuity in the event of a disruption.

    Highly scalable and elastic Component-level scalability makes it possible to scale up and down on demand. Milvus can autoscale at a component level according to the load type, making resource scheduling much more efficient.

    Hybrid search In addition to vectors, Milvus supports data types such as Boolean, integers, floating-point numbers, and more. A collection in Milvus can hold multiple fields for accommodating different data features or properties. Milvus pairs scalar filtering with powerful vector similarity search to offer a modern, flexible platform for analyzing unstructured data. Check https://github.com/milvus-io/milvus/wiki/Hybrid-Search for examples and boolean expression rules.

    Unified Lambda structure Milvus combines stream and batch processing for data storage to balance timeliness and efficiency. Its unified interface makes vector similarity search a breeze.

    Community supported, industry recognized With over 1,000 enterprise users, 9,000+ stars on GitHub, and an active open-source community, you’re not alone when you use Milvus. As a graduate project under the LF AI & Data Foundation, Milvus has institutional support.

    Quick start

    Install Milvus

    Build Milvus from source code

    Check the requirements first.

    Linux systems (Ubuntu 18.04 or later recommended):

    go: >= 1.18
    cmake: >= 3.18
    gcc: 7.5
    

    MacOS systems with x86_64 (Big Sur 11.5 or later recommended):

    go: >= 1.18
    cmake: >= 3.18
    llvm: >= 12
    

    MacOS systems with Apple Silicon (Monterey 12.0.1 or later recommended):

    go: >= 1.18 (Arch=ARM64)
    cmake: >= 3.18
    llvm: >= 13
    

    Clone Milvus repo and build.

    # Clone github repository.
    $ git clone https://github.com/milvus-io/milvus.git
    
    # Install third-party dependencies.
    $ cd milvus/
    $ ./scripts/install_deps.sh
    
    # Compile Milvus.
    $ make
    

    For the full story, see developer's documentation.

    IMPORTANT The master branch is for the development of Milvus v2.0. On March 9th, 2021, we released Milvus v1.0, the first stable version of Milvus with long-term support. To use Milvus v1.0, switch to branch 1.0.

    Milvus 2.0 vs. 1.x: Cloud-native, distributed architecture, highly scalable, and more

    See Milvus 2.0 vs. 1.x for more information.

    Real world demos

    Image search Chatbots Chemical structure search

    Image Search

    Images made searchable. Instantaneously return the most similar images from a massive database.

    Chatbots

    Interactive digital customer service that saves users time and businesses money.

    Chemical Structure Search

    Blazing fast similarity search, substructure search, or superstructure search for a specified molecule.

    Bootcamps

    Milvus bootcamp is designed to expose users to both the simplicity and depth of the vector database. Discover how to run benchmark tests as well as build similarity search applications spanning chatbots, recommendation systems, reverse image search, molecular search, and much more.

    Contributing

    Contributions to Milvus are welcome from everyone. See Guidelines for Contributing for details on submitting patches and the contribution workflow. See our community repository to learn about our governance and access more community resources.

    All contributors




    Documentation

    For guidance on installation, development, deployment, and administration, check out Milvus Docs. For technical milestones and enhancement proposals, check out milvus confluence

    SDK

    The implemented SDK and its API documentation are listed below:

    Attu

    Attu provides an intuitive and efficient GUI for Milvus.

    Community

    Join the Milvus community on Slack to share your suggestions, advice, and questions with our engineering team.

    <img src="https://assets.zilliz.com/readme_slack_4a07c4c92f.png" alt="Miluvs Slack Channel"  height="150" width="500">
    

    You can also check out our FAQ page to discover solutions or answers to your issues or questions.

    Subscribe to Milvus mailing lists:

    Follow Milvus on social media:

    Reference

    Reference to cite when you use Milvus in a research paper:

    @inproceedings{2021milvus,
      title={Milvus: A Purpose-Built Vector Data Management System},
      author={Wang, Jianguo and Yi, Xiaomeng and Guo, Rentong and Jin, Hai and Xu, Peng and Li, Shengjun and Wang, Xiangyu and Guo, Xiangzhou and Li, Chengming and Xu, Xiaohai and others},
      booktitle={Proceedings of the 2021 International Conference on Management of Data},
      pages={2614--2627},
      year={2021}
    }
    

    Acknowledgments

    Milvus adopts dependencies from the following:

    • Thanks to FAISS for the excellent search library.
    • Thanks to etcd for providing great open-source key-value store tools.
    • Thanks to Pulsar for its wonderful distributed pub-sub messaging system.
    • Thanks to RocksDB for the powerful storage engines.

    Milvus is adopted by following opensource project:

    • Towhee a flexible, application-oriented framework for computing embedding vectors over unstructured data.
    • Haystack an open source NLP framework that leverages Transformer models