diff options
| author | Laurent Mazare <laurent.mazare@gmail.com> | 2023-08-17 11:12:05 +0100 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-08-17 11:12:05 +0100 |
| commit | 03be33eea482accbcf4c547728c2db7e24b7ebb0 (patch) | |
| tree | da5680d6d705d9346edbac9f2ce4a05779b86343 /candle-examples/examples/llama_multiprocess/model.rs | |
| parent | d32e8199cd6c8381aa309528675d6d6a88c0f850 (diff) | |
| download | candle-03be33eea482accbcf4c547728c2db7e24b7ebb0.tar.gz candle-03be33eea482accbcf4c547728c2db7e24b7ebb0.tar.bz2 candle-03be33eea482accbcf4c547728c2db7e24b7ebb0.zip | |
Relax the requirements on CustomOp. (#486)
* Relax the requirements on CustomOp.
* Simplify the custom-ops when no backward is required.
Diffstat (limited to 'candle-examples/examples/llama_multiprocess/model.rs')
| -rw-r--r-- | candle-examples/examples/llama_multiprocess/model.rs | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/candle-examples/examples/llama_multiprocess/model.rs b/candle-examples/examples/llama_multiprocess/model.rs index ab4e382c..ad5e4cd2 100644 --- a/candle-examples/examples/llama_multiprocess/model.rs +++ b/candle-examples/examples/llama_multiprocess/model.rs @@ -68,7 +68,7 @@ impl CustomOp1 for AllReduce { } fn all_reduce_sum(x: &Tensor, comm: &Rc<Comm>) -> Result<Tensor> { - x.custom_op1(AllReduce { comm: comm.clone() }) + x.apply_op1(AllReduce { comm: comm.clone() }) } impl TensorParallelRowLinear { |