summaryrefslogtreecommitdiff
path: root/candle-wasm-examples/phi
Commit message (Collapse)AuthorAgeFilesLines
* Quantized GGUF style (#1523)Nicolas Patry2024-01-171-2/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Metal quantized modifications proposal. - Add a device param, wherever needed. - Create new QMetal storage thing that implements QuantizedType. - Update everywhere needed. Fix Python. Fixing examples. Fix: fmt + clippy + stub. Moving everything around. Only missing the actual implems. Fixing everything + adding dequantized kernels. More work. Fixing matmul. Fmt + Clippy Some clippy fixes. Working state. Q2K Metal -> Bugged (also present in GGML). Q4K CPU -> Bugged (present previously, new test catch it). Q5K CPU -> Bugged (present previously). Q8_1 Both -> Never really implemented it seems Q8K metal -> Never implemented in metal Fixing Q2K bug (present in ggml). * Cleanup. * Fix the rebase. * Removing the fences speeds everything up and *is* correct this time... * Cleanup the fence. * After rebase. * Bad code removal. * Rebase after phi2 merge + fix replit default to CPU. * Making the CI happy. * More happy tests. --------- Co-authored-by: Nicolas Patry <nicolas@Nicolass-MacBook-Pro.local>
* Simplifying our internal cargo dependencies. (#1529)Nicolas Patry2024-01-071-3/+3
|
* Bump the crate version to 0.3.3. (#1490)Laurent Mazare2023-12-281-3/+3
|
* Bump the crate version to 0.3.2. (#1452)Laurent Mazare2023-12-171-3/+3
|
* Phi 2 wasm (#1432)Radamés Ajna2023-12-143-26/+102
| | | | | | | | | * add phi 2.0 quantized model wasm * cols * spell * bug
* Update for 0.3.1. (#1324)Laurent Mazare2023-11-111-3/+3
|
* [Wasm] Add puffin phi model to wasm (#1166)Radamés Ajna2023-10-253-38/+204
| | | | | | | * load config from file, add puffin phi links * format * add prompt examples
* Bump the version to 0.3.0. (#1014)Laurent Mazare2023-10-011-3/+3
| | | | | * Bump the version to 0.3.0. * Changelog update.
* Phi 1.5 wasm module (#966)Radamés Ajna2023-09-277-0/+725
* add phi wasm module * replace input with textarea * trim input prompt * stop on <|endoftext|> * formatting * clean up * add blurb, and syntax highlighting * add phi-v1.5 wasm * add note * hide Options on details * add first token to generated text * whitespaces for new line * fix: abort -> aborted