SearXNG in Rust

A SearXNG-style metadata search engine written in Rust. Fans out queries to multiple search engines concurrently, scrapes their HTML results, deduplicates by normalized URL, and ranks using Reciprocal Rank Fusion (RRF).

How it works

A search request arrives at GET /search?q=<query> The query is sent concurrently to DuckDuckGo, Brave, Startpage, and Yahoo via reqwest Each engine parses the HTML response with scraper (CSS selectors over Mozilla's html5ever) Results are deduplicated by normalized URL (tracking params stripped, locale prefixes removed, query params sorted) Duplicate URLs are merged and scored with RRF ( score = Σ 1/(60 + rank) across engines) — pages returned by multiple engines rank higher The top results are returned as JSON

Requirements

Rust 1.75+

Cargo

Installation

As a library

cargo add metadata-search-engine-rs

Or add manually to Cargo.toml :

... continue reading