diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2023-08-17 10:07:13 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-08-17 10:07:13 +0100 |
| commit | d32e8199cd6c8381aa309528675d6d6a88c0f850 (patch) | |
| tree | a77b1e6910e9aec0a87813cf6a8f5120838470ce /candle-nn/examples/basic_optimizer.rs | |
| parent | d99cac3ec38a52bd81cc72059259729e7272e490 (diff) | |
| download | candle-d32e8199cd6c8381aa309528675d6d6a88c0f850.tar.gz candle-d32e8199cd6c8381aa309528675d6d6a88c0f850.tar.bz2 candle-d32e8199cd6c8381aa309528675d6d6a88c0f850.zip | |
Layer norm tweaks (#482)
* Add some options to make layer-norm more configurable.
* Add the rms-norm variant.
* Replace the RmsNorm with the shared bits.
Diffstat (limited to 'candle-nn/examples/basic_optimizer.rs')
0 files changed, 0 insertions, 0 deletions