diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2023-09-30 20:12:41 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-09-30 20:12:41 +0100 |
| commit | 4e55aaa51f61a2472c24c52d7b3596f4d0bca4f7 (patch) | |
| tree | 8e7076acefdb02d25691a852f296b6120771ff73 /candle-wasm-tests | |
| parent | deee7612da7dcda1aa1cfd4237f4858d9f5ed8c7 (diff) | |
| download | candle-4e55aaa51f61a2472c24c52d7b3596f4d0bca4f7.tar.gz candle-4e55aaa51f61a2472c24c52d7b3596f4d0bca4f7.tar.bz2 candle-4e55aaa51f61a2472c24c52d7b3596f4d0bca4f7.zip | |
Simd128 version of the q2k-q8k vecdot product. (#1011)
* Sketch the simd128 version of q2k vecdot.
* Use a single accumulator.
* Simdify the q2k-q8k vecdot product.
* Cosmetic change.
Diffstat (limited to 'candle-wasm-tests')
| -rw-r--r-- | candle-wasm-tests/tests/quantized_tests.rs | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/candle-wasm-tests/tests/quantized_tests.rs b/candle-wasm-tests/tests/quantized_tests.rs index 643eb2f0..fcd812c1 100644 --- a/candle-wasm-tests/tests/quantized_tests.rs +++ b/candle-wasm-tests/tests/quantized_tests.rs @@ -106,7 +106,7 @@ fn ggml_matmul_error_test<T: GgmlType>() -> Result<()> { let ggml_error = ggml_reference_matmul_error(T::DTYPE)?; - if error > GGML_MAX_DOT_PRODUCT_ERROR { + if !error.is_finite() || error > GGML_MAX_DOT_PRODUCT_ERROR { candle::bail!( "Dot product error {} exceeds max error {}", error, |