Command line interface for accessing the Open Web Index shards and slices.
README.md

Benchmarks #

Performance benchmarking scripts that are not pytest tests.

These files are excluded from pytest collection via pyproject.toml.

Contents #

Database Benchmarks (core/db/) #

  • benchmark_async_executor.py - Async query executor performance
  • benchmark_comprehensive.py - Comprehensive database operations
  • benchmark_executor.py - Sync query executor performance
  • benchmark_query.py - Query performance testing
  • inspect_schema.py - Database schema inspection

Filesystem Benchmarks (core/fsspec/) #

  • benchmark_async.py - Async filesystem operations
  • benchmark_connection.py - Connection pooling and reuse
  • benchmark_core_fsspec.py - Core fsspec operations
  • benchmark_listing.py - Directory listing performance
  • benchmark_listing_duckdb.py - DuckDB-based listing
  • benchmark_optimized.py - Optimized implementations

Command Benchmarks (cmd/subcmds/) #

  • s3_benchmark.py - S3 storage operations

Usage #

Run benchmarks directly:

uv run tests/benchmarks/core/db/benchmark_query.py
uv run tests/benchmarks/core/fsspec/benchmark_async.py

These are kept to measure performance improvements and identify bottlenecks during development.