ptr.pet / hydrant
very fast at protocol indexer with flexible filtering, xrpc queries, cursor-backed event stream, and more, built on fjall
rust fjall at-protocol atproto indexer
Star
Fork 3
Watch

Commits on fix-counts

[db] refactor how repo counts are handled fix-counts
dawn committed
[backfill/sparse] optimize, make auto the default
dawn committed
[backfill/sparse] increase chunk size to 100
dawn committed
[backfill] initial sparse repo backfill implementation
dawn committed
[relay] make repos start as synced instead of 'backfilling'
dawn committed
[ingest] default tooBig to false when desering commits
dawn committed
[relay] introduce a negative cache for bad did/source-host pairs so we dont have to refresh did doc every single time, skip getRepoStatus check
dawn committed
[ingest] add more stats around signature verifs and message handling
dawn committed
[ingest] add stats for relay worker shards
dawn committed
[ingest] add perf stats tracking for firehose connections
dawn committed
[relay] improve how host connections with stale cursors get treated, hopefully fix a nasty bug with message deduping that caused connections to stall, more debugging
dawn committed
[api] implement get record by uri
dawn committed
[api] add resolveMiniDoc aliases
dawn committed
[scripts] add scripts for validating failing pds' against another relay and general host status comparisons
dawn committed
[lib,api] include pds metadata in /firehouse/source(s) if the host is a pds
dawn committed
[lib,api] return all known sources from /firehose/sources, allow filtering, allow querying single host using /firehose/source
dawn committed
[lib] user-keyspace feature for letting users open keyspaces in hydrant db
dawn committed
[stream] improve the way we handle consumer backpressure, remove unnecessary fixed pause
dawn committed
[jetstream] add live cutover like the rest of the streams
dawn committed
[jetstream] stage backfill commits also
dawn committed
[jetstream] introduce jetstream compatible endpoint for indexer and relay
dawn committed
[relay] fix pds account counts to only those known by hydrant, make them consistent
dawn committed
[tests] improve test times, split and rename some tests
dawn committed
[build] fix nix build
dawn committed
[tests] use cargo artifact paths
dawn committed
[ingest] add sharded mailbox
dawn committed
[hydrant] clippy fixes
oyster.cafe committed
[db] use drop_range for ephemeral gc
dawn committed
[api] websocket pong & better ping, round 2
oyster.cafe committed
[lib,api] chunk streaming on replay, add a live buffer, chunk ephmeral gc deletes
dawn committed
Binding multiple listen addresses
oyster.cafe committed
[tests] use plc.klbr.net instead of plc.wtf
dawn committed
[ingest] change the unbounded channels to be bounded
dawn committed
[backfill] dont hold store / mst tree over db commit, drop early when we can
dawn committed
[lib] expose backlinks properly, add dids field support
dawn committed
[ingest,stream] dont read from db, use live event
dawn committed
[db] compact manually if we pruned enough events
dawn committed
[deps] update fjall and friends
dawn committed
[docs] update verbiage
dawn committed
[db] make count tracking more durable
dawn committed
[backfill] fix count tracking on resync
dawn committed
[docs] point to docs
dawn committed
[flake] remove conflicting rust deps from devshell override
dawn committed
[docs] update verbiage
dawn committed
[docs] move title headers into title frontmatter
dawn committed
[docs] fix rewrites
dawn committed
[db] improve ephemeral task, add test for the relay ttl to the gc test
dawn committed
[db] print pruned events log at info level
dawn committed
[docs] update links in docs readme
dawn committed
[docs] add building and deployment
dawn committed
[docs] add request body tables, restore config descriptions from readme
dawn committed
[docs] convert nested lists to headings in api docs
dawn committed
[flake] set VERBIAGE_TITLE=hydrant, update verbiage input
dawn committed
[ingest] store resync buffer commits with named tags
dawn committed
[docs] update verbiage to latest (redirect fix)
dawn committed
[docs] initial documentation + add verbiage to devshell
dawn committed
[firehose] periodically retry offline hosts (every 30 minutes)
dawn committed
[firehose,lib,api] add is_source_running, shortcircuit requestCrawl if source is already running to prevent task restart
dawn committed
[lib,api] add new host limit for hosts added via requestCrawl
dawn committed
[config] enable ephemeral mode by default in relay mode
dawn committed