eval/alpine · pac · Tangled

ryan.freumh.org / pac

This repository has no description

pac eval alpine

1 folder · 10 files

Ryan Gibb · harness: each ecosystem's refusal rule is one refused.sh, which its scale.sh and check.sh both source · 2d ago

eval: fold the regression set into scale.sh, recorded answers under baseline/

eval: one check interface with valid and minimal verdicts, errors never counted as refusals or invalid, absolute output directories, one query key, tool and pubgrub modes everywhere

harness: each ecosystem's refusal rule is one refused.sh, which its scale.sh and check.sh both source

drivers: one output format, one exit-code convention and one order signature with a seeded random order; shared helpers in lib/common

eval: one check interface with valid and minimal verdicts, errors never counted as refusals or invalid, absolute output directories, one query key, tool and pubgrub modes everywhere

eval: a regression line is a whole query in the tool's syntax, in queries.txt; opam adds its two --with-test queries

eval: opam's and alpine's refusals in one file each, read by the run and the check alike; npm's lock walk in Python alone and cargo's newest in scale.py alone; the README says who reads the rows

harness: each ecosystem's refusal rule is one refused.sh, which its scale.sh and check.sh both source

harness: each ecosystem's refusal rule is one refused.sh, which its scale.sh and check.sh both source

eval: alpine reads the apk setup.sh resolved; seed.sh keeps roots.txt until it finishes and bounds pac; stale names

eval: an uncompared answer is not exact; a query named twice runs once; queries read once; pac's statuses in the summary; npm totals per query