ptr.pet / hydrant
very fast at protocol indexer with flexible filtering, xrpc queries, cursor-backed event stream, and more, built on fjall
rust fjall at-protocol atproto indexer
Star
Fork 3
Watch

Commits on main

[backfill] start a sparse scan from the latest commit when the probe has no proof main
dawn committed
[api] erase a whole repository on redaction instead of keeping its cids
Signed-off-by: dawn <90008@klbr.net>
dawn committed
[ffi] ignore SIGPIPE so a departed client can't kill the embedder
Signed-off-by: dawn <90008@klbr.net>
dawn committed
[ffi] drop -lgcc_s from the linux cgo flags
Signed-off-by: dawn <90008@klbr.net>
dawn committed
[nix] export the ffi staticlib as packages.ffi
Signed-off-by: dawn <90008@klbr.net>
dawn committed
[ffi] make the go wrapper go-gettable
Signed-off-by: dawn <90008@klbr.net>
dawn committed
[db] report a poisoned database through run instead of exiting
Signed-off-by: dawn <90008@klbr.net>
dawn committed
[control] shut hydrant down cleanly
Signed-off-by: dawn <90008@klbr.net>
dawn committed
[ffi] add a C api and go wrapper for embedding hydrant
Signed-off-by: dawn <90008@klbr.net>
dawn committed
[api] serve management endpoints on unix binds only by default
Signed-off-by: dawn <90008@klbr.net>
dawn committed
[api] serve the api on unix sockets
Signed-off-by: dawn <90008@klbr.net>
dawn committed
[config] build config from any key lookup, not just the process env
Signed-off-by: dawn <90008@klbr.net>
dawn committed
[tests] deflake api_firehose_sources timing
Signed-off-by: dawn <dawn@tangled.org>
dawn committed
[crawler] list repos of a newly followed PDS once in indexer mode
dawn committed
[all] fmt
dawn committed
[crawler] split the per-PDS listRepos walk out of deep discovery
dawn committed
[api] serve requestCrawl in indexer mode
dawn committed
[deps] bump fjall and lsm-tree forks onto upstream
dawn committed
[ingest] share one tls connector across firehose connections
dawn committed
[seed] seed absent PDS cursors from listHosts again
dawn committed
[ingest] live tail new PDS sources
dawn committed
[nix] include benches in fileset
dawn committed
[firehose] admit seeded PDS sources without daily quota check
dawn committed
[stream] fix since deserialization test for invalid tid
dawn committed
[config] say what verify_cids protects now that record bodies are always hashed
dawn committed
[beads] close hydrant-pwu, file hydrant-u0n
dawn committed
[bench] counterbalance compare-ref across both run orders
dawn committed
[bench] keep the checkout path out of the bench binary
dawn committed
[bench] criterion benches for car, cid, mst and sparse paths with a regression gate
dawn committed
[main] move the global allocator into its own file
dawn committed
[beads] close hydrant-4xb
dawn committed
[car] prove record blocks were cid-checked by type and hash each once
dawn committed
[beads] close hydrant-642, file hydrant-4xb
dawn committed
[backfill] test verify_cids against forged sparse getRecord proofs
dawn committed
[backfill] time the current full backfill path in backfill_strategy_bench
dawn committed
[beads] close hydrant-cee
dawn committed
[car] parse commit-sized cars with hydrant's verifying parser
dawn committed
[stream] expose the newest stored event id at /stream/head
dawn committed
[beads] close hydrant-e0w
dawn committed
[sparse] scan proof cars with an explicit stack
dawn committed
[beads] close hydrant-md0
dawn committed
[mst] walk full repos with the node decoder shared with sparse backfill
dawn committed
[beads] close hydrant-3kt, file hydrant-md0
dawn committed
[backfill] walk full repo msts sequentially off the async runtime
dawn committed
[beads] close hydrant-j88
dawn committed
[car] keep full repo car blocks in a seeded hash map
dawn committed
[beads] close hydrant-870, file hydrant-j88 and hydrant-3kt
dawn committed
[backfill] parse and verify full repo cars off the async runtime
dawn committed
[car] verify block cids while parsing
dawn committed
[beads] close hydrant-pt1
dawn committed
[deps] enable sha2 asm for hardware sha256 on aarch64
dawn committed
[beads] close hydrant-xzs
dawn committed
[ingest] verify CAR block CIDs by default
dawn committed
[beads] close hydrant-abq, file sequencer follow-ups
dawn committed
[debug] cap /debug/seed_events at 10k events like its sibling
dawn committed
[db] write down where stream position counters stop
dawn committed
[db] refuse stream positions past i64::MAX
dawn committed
[stream] check a live /subscribe event for redaction before sending it
dawn committed
[stream] end a stream thread as soon as its subscriber hangs up
dawn committed
[stream] hold a channel slot for a stream's closing error
dawn committed