Skip to content
Tech News
clear
Topics: Today This Week This Month This Year

Manticore Search adds automatic document chunking to its vector search engine

Manticore Search now supports built-in chunking for embedding-based vector search, letting users add a chunk_strategy option directly to a table's vector column instead of manually splitting long documents before indexing. The database can split text into pieces, embed each chunk, and search across all of them within a single table, eliminating the need for a separate chunking pipeline or secondary table. Five strategies are offered: truncate, mean, fixed, recursive, and sentence, with the latter three requiring a float_vector_array column to store multiple vectors per document.

Rust's gearhash crate adds NEON backend, doubling ARM64 performance

The gearhash crate, used for content-defined chunking via the GEAR rolling hash, has been updated to version 0.1.4 with a new NEON-based backend for ARM64 processors. The change is automatically selected on aarch64 systems and remains backwards compatible, delivering roughly double the throughput at typical chunk sizes without requiring any code changes from users.

Today's top topics: openai apple anthropic artificial intelligence dario amodei samsung ai safety android authority beats 360 claude opus 5.5
View all today's topics →