divepool.com / embedding_firehose_client
Example client for the highly experimental divepool embedding firehose
Star
Fork 0
Watch

match mlx_embeddings float32 pooling precision in verify.py master

mlx_embeddings.mean_pooling casts the attention mask to float32 before accumulating the pooling sum. verify.py was staying in bfloat16, losing precision during summation over many tokens. Cast h and mask to float32 for pooling and dense projection to match the server-side computation. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Author jraedisch Co-author Claude Opus 4.6 (1M context) Date Commit fae2c151 Parent 26c66870
+5 -6
1 changed file