Commit Graph
28864 Commits
Author SHA1 Message Date
Adam KroppandRyan Curtin bc08ce25d2 Update src/mlpack/methods/ann/layer/linear3d.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:58:33 -04:00
Adam KroppandRyan Curtin 50c8f09902 Update src/mlpack/methods/ann/layer/linear.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:57:55 -04:00
Adam KroppandRyan Curtin 5cc5e9baa6 Update src/mlpack/methods/ann/layer/leaky_relu.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:57:16 -04:00
Adam KroppandRyan Curtin b2b05900d5 Update src/mlpack/methods/ann/layer/identity.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:56:33 -04:00
Adam KroppandRyan Curtin 28328e23e0 Update src/mlpack/methods/ann/layer/grouped_convolution.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:55:42 -04:00
Adam KroppandRyan Curtin bf18a3d516 Update src/mlpack/methods/ann/layer/elu.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:45:08 -04:00
Adam KroppandRyan Curtin 4bae489b06 Update src/mlpack/methods/ann/layer/dropout.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:44:48 -04:00
Adam KroppandRyan Curtin 06c6dd987f Update src/mlpack/methods/ann/layer/convolution.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:42:32 -04:00
Adam KroppandRyan Curtin 72a26ba24b Update src/mlpack/methods/ann/layer/concatenate.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:42:15 -04:00
Adam KroppandRyan Curtin 1dab4e23a6 Update src/mlpack/methods/ann/layer/concat_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:41:33 -04:00
Adam KroppandRyan Curtin c7d94a6ff3 Update src/mlpack/methods/ann/layer/concat_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:41:00 -04:00
Adam KroppandRyan Curtin 6417e309c8 Update src/mlpack/methods/ann/layer/concat.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:40:02 -04:00
Adam KroppandRyan Curtin b7c25a8864 Update src/mlpack/methods/ann/layer/concat.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:38:59 -04:00
Adam KroppandRyan Curtin bad9160509 Update src/mlpack/methods/ann/layer/celu.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:38:38 -04:00
Adam KroppandRyan Curtin 4723829f43 Update src/mlpack/methods/ann/layer/c_relu_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:38:20 -04:00
Adam KroppandRyan Curtin dd3e259577 Update src/mlpack/methods/ann/layer/batch_norm.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:32:47 -04:00
Adam KroppandRyan Curtin 9c2bf7f095 Update src/mlpack/methods/ann/layer/alpha_dropout.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:32:15 -04:00
Adam KroppandRyan Curtin 77e41afdf1 Update src/mlpack/methods/ann/layer/multihead_attention_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:31:30 -04:00
Adam KroppandRyan Curtin e8e8432ea7 Update src/mlpack/methods/ann/layer/multihead_attention_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:31:04 -04:00
Adam KroppandRyan Curtin e5320bd564 Update src/mlpack/methods/ann/layer/multihead_attention_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:30:51 -04:00
Adam KroppandRyan Curtin aec1c16161 Update src/mlpack/methods/ann/layer/add.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:30:20 -04:00
Adam KroppandRyan Curtin b891e25b37 Update src/mlpack/methods/ann/ffn_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:27:28 -04:00
Adam KroppandRyan Curtin e4309d0947 Update src/mlpack/methods/ann/ffn_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:26:59 -04:00
Adam KroppandRyan Curtin a3466f29f2 Update src/mlpack/methods/ann/ffn_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:26:50 -04:00
Adam KroppandRyan Curtin a4ab4a6dee Update src/mlpack/methods/ann/ffn_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:26:33 -04:00
Adam KroppandRyan Curtin efae2fd1f6 Update src/mlpack/methods/ann/ffn_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:26:16 -04:00
Adam KroppandRyan Curtin 91a62a56ab Update src/mlpack/methods/ann/ffn_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-01 17:26:00 -04:00
Adam Kropp b26a2fcd99 Merge remote-tracking branch 'upstream/master' into adapt_multihead 2023-10-31 12:57:03 -04:00
conradsnicta 4df75cca46 detect C++17 mode in MSVC (#3555) 2023-10-29 13:52:38 +01:00
Adam Kropp 15c2c0f274 Adding input and output parameters to Backward() method on Layer. 2023-10-27 13:33:19 -04:00
Ryan Curtin 5e8a27d6bc Merge pull request #3550 from rcurtin/https-downloader
Use HTTPS for auto-downloaded dependencies
2023-10-26 11:00:10 -04:00
Ryan Curtin 06a2b04cd7 Bump Armadillo version that the autodownloader uses. 2023-10-24 13:36:25 -04:00
Marcus Edel 99cde28a02 Merge branch 'master' into https-downloader 2023-10-23 19:38:19 -04:00
Ryan Curtin 4472c62f83 Update HISTORY. 2023-10-23 17:09:30 -04:00
Ryan Curtin e7cc4b4f63 Use HTTPS for auto-downloaded dependencies. 2023-10-23 17:07:14 -04:00
Adam Kropp a0c374776c Update softmax_impl.hpp
comment out unusued parameter "input"
2023-10-23 14:31:28 -04:00
akropp 2791789b5e Fix references to "input" in the Backwards call. 2023-10-23 13:39:41 -04:00
Adam Kropp 175a9e4597 ANN Layers Template Parameter Consistency (#3546) 2023-10-22 14:44:33 +02:00
Ryan Curtin 699aebe781 Another cran fix round two (#3543)
* Add @aliases to make CRAN happy after breaking roxygen2 change.
2023-10-22 14:39:24 +02:00
Adam Kropp ae354c8d11 Fix L1 regularization in case where weight is zero (#3545) 2023-10-21 09:25:49 +02:00
akropp 7993469d4c Fix LayerNorm
(cherry picked from commit 7259b714b33587629803c77b399213ecc15c84a8)
2023-10-20 07:50:32 -04:00
akropp 89b78f8c02 Add self-attention flag to MultiheadAttention layer
(cherry picked from commit e64b454df52f9f59084137bc1c3ea99e6d46c72e)
2023-10-20 07:27:03 -04:00
akropp dcf4ce3961 Adapt multihead_attention
(cherry picked from commit 20f646ef2bfc2d457b57f6496a845b8f48a287fd)
2023-10-20 07:26:37 -04:00
Adam Kropp 441248f567 Update layer_norm.hpp
Removed default value for eps.
2023-10-20 05:59:07 -04:00
akropp b686012dd7 Remove unnecessary template arg
(cherry picked from commit dfafc151ffb1528e52830a56cdfcfc24a154142e)
2023-10-19 14:19:27 -04:00
akropp ed0b423083 Remove unnecessary template arg
(cherry picked from commit 78c4ccb35c6237a52ddecf06d73d5922b3399925)
2023-10-19 14:18:30 -04:00
akropp 4de7035895 Use MakeAlias to slice input data
(cherry picked from commit 0728f3b0a658a7263e6fbdf1002b217418ce3adb)
2023-10-19 10:22:01 -04:00
Adam Kropp 0a485372c6 Pass the correct "input" values to the sub-layers during the Backward pass
(cherry picked from commit 1593e6e8aff2315fe13656a575aa77e7969d6583)
2023-10-18 15:14:25 -04:00
Adam Kropp beb2873893 Pass the correct "input" values to the sub-layers during the Backward pass
(cherry picked from commit fd105b8edd16ad020f0b9717f1f80570dda2c936)
2023-10-18 15:14:17 -04:00
Adam Kropp 8ef9f590a4 Adapt LayerNorm to new Layer interface.
(cherry picked from commit 4eff1b39ee15fd66bb8c64b85721e07d56c3b9b1)
2023-10-18 15:10:05 -04:00