Something went wrong. Try again.
A lexicon-driven AppView for ATProto.
Something went wrong. Try again.
Commits on feat/backfill-concurrency
Trezy 016b0e52 fix: prevent opening "discovering trepos stage" from locking the ui thread feat/backfill-concurrency
Signed-off-by: Trezy <tre@trezy.com>
fix: prevent opening "discovering trepos stage" from locking the ui thread feat/backfill-concurrency
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy e8268c40 fix: allow log verbosity toggle to override env var
Signed-off-by: Trezy <tre@trezy.com>
fix: allow log verbosity toggle to override env var
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
docs: update docs to cover backfill updates
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
fix: reset backfill ui when flushing details
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 62adab05 fix: prevent backfill jobs from locking locking out pause/cancellation
Signed-off-by: Trezy <tre@trezy.com>
fix: prevent backfill jobs from locking locking out pause/cancellation
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
test: add tests for backfill concurrency
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy d38d05d6 fix: restore missing log events for verbose logging
Signed-off-by: Trezy <tre@trezy.com>
fix: restore missing log events for verbose logging
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 3a0fb9cb fix: better pool size accounting when using sqlite
Signed-off-by: Trezy <tre@trezy.com>
fix: better pool size accounting when using sqlite
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
fix: remove counts from records dropdowns
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 3e33527c fix: virtualize backfill details and move event stream into a worker
Signed-off-by: Trezy <tre@trezy.com>
fix: virtualize backfill details and move event stream into a worker
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
feat: make verbose event logs configurable
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy b0d382b2 feat: recommend restart when backfill concurrency settings dont match existing connection pool size
Signed-off-by: Trezy <tre@trezy.com>
feat: recommend restart when backfill concurrency settings dont match existing connection pool size
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy bd65caf3 feat: allow backfill jobs to be paused and resumed
Signed-off-by: Trezy <tre@trezy.com>
feat: allow backfill jobs to be paused and resumed
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy f83f1500 fix: make backfill progress headings more accessible
Signed-off-by: Trezy <tre@trezy.com>
fix: make backfill progress headings more accessible
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 3d31877d fix: prevent concurrency settings from being set to invalid values
Signed-off-by: Trezy <tre@trezy.com>
fix: prevent concurrency settings from being set to invalid values
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
fix: prevent reprocessing of sse
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
chore: remove unused module
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
fix: remove cleanup delay caused by tick eater
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
fix: clamp backfill concurrency values
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 22f3ba92 fix: use the correct connection pool for record upserts
Signed-off-by: Trezy <tre@trezy.com>
fix: use the correct connection pool for record upserts
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 66b4804a fix: get max connections from Postgres instead of current connections
Signed-off-by: Trezy <tre@trezy.com>
fix: get max connections from Postgres instead of current connections
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 060cba30 feat: make backfill collection discovery concurrent
Signed-off-by: Trezy <tre@trezy.com>
feat: make backfill collection discovery concurrent
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
feat: increase backfill record batch inserts
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy c14a168d fix: separate backfill db connection pool from main app pool
Signed-off-by: Trezy <tre@trezy.com>
fix: separate backfill db connection pool from main app pool
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
feat: add backfill concurrency settings
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
fix: restore plc concurrency
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 66fe12ac feat: add more detailed information to backfill UI
Signed-off-by: Trezy <tre@trezy.com>
feat: add more detailed information to backfill UI
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 8f21474d feat: parallelize PDS resolution and record retrieval during backfills
Signed-off-by: Trezy <tre@trezy.com>
feat: parallelize PDS resolution and record retrieval during backfills
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 60cf8868 ci: publish Rust binaries to Github Releases ci/separate-binaries
Signed-off-by: Trezy <tre@trezy.com>
ci: publish Rust binaries to Github Releases ci/separate-binaries
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy dfd3456b Merge pull request #52 from gamesgamesgamesgamesgames/feat/add-filter-to-db-query v2.9.0-dev.1
Trezy committed
Trezy a0edded6 docs: add `db.query`s new `filter` prop to the docs feat/add-filter-to-db-query
Signed-off-by: Trezy <tre@trezy.com>
docs: add `db.query`s new `filter` prop to the docs feat/add-filter-to-db-query
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 698c0992 fix: filter nesting was allowed to 6 levels instead of 5
Signed-off-by: Trezy <tre@trezy.com>
fix: filter nesting was allowed to 6 levels instead of 5
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 950594bb feat: add support for nexted syntax in field selectors
Signed-off-by: Trezy <tre@trezy.com>
feat: add support for nexted syntax in field selectors
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
feat: add `filter` to `db.query`
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy committed
Trezy afde8027 fix: delegate to backend for network lexicon resolution v2.8.1-dev.1
Signed-off-by: Trezy <tre@trezy.com>
fix: delegate to backend for network lexicon resolution v2.8.1-dev.1
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
docs: fix links in site fix-docs-links
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
docs: fix release dates fix-article-slugs
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 0bd39868 ci: update paths filter action paths-filter-action
Signed-off-by: Trezy <tre@trezy.com>
ci: update paths filter action paths-filter-action
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
docs: 2.8 release article 2.8-release-article
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy committed
docs: fix publish data release-articles
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
docs: move image to the right spot
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 37dac2f7 ci: prevent action credentials from breaking merge to dev fix-merge-2
Signed-off-by: Trezy <tre@trezy.com>
ci: prevent action credentials from breaking merge to dev fix-merge-2
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
docs: add blogs for 2.5, 2.6, and 2.7 releases
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy f4da2cd2 Merge pull request #38 from gamesgamesgamesgamesgames/upgrade-backfills v2.6.0-dev.19
Trezy committed
Trezy cb3797e9 fix: only count successful PDS resolutions, cap retry-after, update backfill docs upgrade-backfills
Signed-off-by: Trezy <tre@trezy.com>
fix: only count successful PDS resolutions, cap retry-after, update backfill docs upgrade-backfills
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy f25ade76 fix: chunk bulk inserts for sqlite, use rows_affected for counts, faster cancel checks, users page a11y
Signed-off-by: Trezy <tre@trezy.com>
fix: chunk bulk inserts for sqlite, use rows_affected for counts, faster cancel checks, users page a11y
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 274ab01d fix: bulk insert in discovery, seed records on resume, dedupe retry helper, add cancel tests
Signed-off-by: Trezy <tre@trezy.com>
fix: bulk insert in discovery, seed records on resume, dedupe retry helper, add cancel tests
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
fix: use correct permission IDs in dashboard
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed
Trezy 7e6a1f11 fix: move user permission management into sheets
Signed-off-by: Trezy <tre@trezy.com>
fix: move user permission management into sheets
Signed-off-by: Trezy <tre@trezy.com>
Trezy committed