diff options
author | Nicolas Patry <patry.nicolas@protonmail.com> | 2023-12-20 09:54:19 +0100 |
---|---|---|
committer | Nicolas Patry <patry.nicolas@protonmail.com> | 2023-12-20 09:54:19 +0100 |
commit | 9b5e4843a63180a2803b1e836b4ca90f14281d03 (patch) | |
tree | 32dc8468d9201cf079d437f96ad5cdadb2dddb42 /candle-pyo3/test_pytorch.py | |
parent | 03641293eeb1dd0ff3d5a93e85c7f9eb289704e4 (diff) | |
download | candle-9b5e4843a63180a2803b1e836b4ca90f14281d03.tar.gz candle-9b5e4843a63180a2803b1e836b4ca90f14281d03.tar.bz2 candle-9b5e4843a63180a2803b1e836b4ca90f14281d03.zip |
Optimizing decode matmul (Phi at 28tok/s on M3).
Adding some benchmark in order to help checking out matmul performance.
Diffstat (limited to 'candle-pyo3/test_pytorch.py')
0 files changed, 0 insertions, 0 deletions