Commit Graph
28986 Commits
Author SHA1 Message Date
Ryan Curtin ca8ffcd796 Fix call to preprocess_split() in generated documentation. 2023-11-24 12:26:58 -05:00
Ryan Curtin 751ba46521 Merge pull request #3557 from rcurtin/additional-cxx17-msvc-doc-fix
Remove other uses of /Zc:__cplusplus in the documentation.
2023-11-22 08:48:24 -05:00
Ryan Curtin 1839274ebb Merge pull request #3547 from akropp/adapt_multihead
Adapt MultiheadAttention and LayerNorm to new Layer interface
2023-11-22 08:46:15 -05:00
Adam KroppandRyan Curtin cb7c6d32e1 Update HISTORY.md
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-20 15:11:14 -05:00
Adam KroppandRyan Curtin 27eae7c149 Update HISTORY.md
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-20 15:11:01 -05:00
Adam KroppandRyan Curtin 0f7f472da6 Update src/mlpack/methods/ann/ffn_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-20 15:10:51 -05:00
Adam KroppandRyan Curtin 7bce96af3f Update src/mlpack/methods/ann/ffn_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-20 15:10:43 -05:00
Adam Kropp df248103aa Merge branch 'adapt_multihead' of https://github.com/akropp/mlpack into adapt_multihead 2023-11-16 13:46:51 -05:00
Adam Kropp 8e0039d3b3 Update HISTORY.md 2023-11-16 13:46:47 -05:00
Adam Kropp 511fe6970b Add author lines
Added to the files where I made meaningful logic changes.
2023-11-16 13:46:40 -05:00
Adam KroppandRyan Curtin 0d4eb701f9 Update src/mlpack/methods/ann/layer/multihead_attention.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-16 09:19:22 -05:00
Adam KroppandRyan Curtin 13cb8c2260 Update src/mlpack/methods/ann/layer/multihead_attention.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-16 09:19:06 -05:00
Adam KroppandRyan Curtin def2346094 Update src/mlpack/methods/ann/layer/multihead_attention.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-16 09:18:53 -05:00
Adam KroppandRyan Curtin 2328247445 Update src/mlpack/methods/ann/layer/multihead_attention_impl.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-16 09:18:42 -05:00
Adam KroppandRyan Curtin 27ad35c5ca Update src/mlpack/methods/ann/layer/layer_norm.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-16 09:18:31 -05:00
Adam KroppandRyan Curtin 130b075d2e Update src/mlpack/methods/ann/activation_functions/hard_swish_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-16 09:18:20 -05:00
Adam Kropp 74f42a4e1b Fix bug with old armadillo version 2023-11-16 09:04:41 -05:00
Adam Kropp 8ad2e225da Temporary debugging spew to see why this fails in azure 2023-11-15 10:17:32 -05:00
Adam Kropp 677a6d8487 input dimension size calc was wrong in Reset() 2023-11-15 10:17:02 -05:00
Adam Kropp d90282abf5 Update elish_function.hpp 2023-11-14 10:25:38 -05:00
Adam Kropp fdb29d3a73 Update elish_function.hpp 2023-11-14 10:11:50 -05:00
Adam Kropp b788e4a8f2 Perf improvement 2023-11-14 10:03:20 -05:00
Adam Kropp a389184f48 Update elish_function.hpp 2023-11-14 07:32:13 -05:00
Adam Kropp 62cedfdb4b Fix conditionals 2023-11-13 18:11:28 -05:00
Adam Kropp 1539b6e7db Remove commentary 2023-11-13 16:03:39 -05:00
Adam Kropp deb68b984c Fix deriv 2023-11-13 16:01:51 -05:00
Adam Kropp 5c7fde65a4 Fixes 2023-11-13 15:53:09 -05:00
Adam KroppandRyan Curtin 94bb5ff521 Update src/mlpack/methods/ann/layer/multihead_attention.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 15:45:43 -05:00
Adam KroppandRyan Curtin 4cb0cd111c Update src/mlpack/methods/ann/layer/multihead_attention.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 15:32:27 -05:00
Adam KroppandRyan Curtin dfcf40a71f Update src/mlpack/methods/ann/layer/multihead_attention.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 15:30:25 -05:00
Adam KroppandRyan Curtin d00446231a Update src/mlpack/methods/ann/layer/multihead_attention.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 15:29:23 -05:00
Adam KroppandRyan Curtin 4244a337a9 Update src/mlpack/methods/ann/activation_functions/spline_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 15:27:46 -05:00
Adam KroppandRyan Curtin cd2c13e4b4 Update src/mlpack/methods/ann/activation_functions/tanh_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 15:27:00 -05:00
Adam KroppandRyan Curtin 26b031110e Update src/mlpack/methods/ann/activation_functions/tanh_exponential_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 15:26:11 -05:00
Adam KroppandRyan Curtin 1cf92e5f30 Update src/mlpack/methods/ann/activation_functions/swish_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 15:24:57 -05:00
Adam KroppandRyan Curtin c8c8dbe020 Update src/mlpack/methods/ann/activation_functions/softsign_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 15:05:10 -05:00
Adam KroppandRyan Curtin e8f64d5c40 Update src/mlpack/methods/ann/activation_functions/softplus_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:52:50 -05:00
Adam KroppandRyan Curtin 8914a1db6a Update src/mlpack/methods/ann/activation_functions/silu_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:52:17 -05:00
Adam KroppandRyan Curtin ce538a8fe4 Update src/mlpack/methods/ann/activation_functions/rectifier_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:51:53 -05:00
Adam KroppandRyan Curtin 7ab7d41674 Update src/mlpack/methods/ann/activation_functions/quadratic_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:51:30 -05:00
Adam KroppandRyan Curtin 4f66883d5e Update src/mlpack/methods/ann/activation_functions/poisson1_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:46:28 -05:00
Adam KroppandRyan Curtin 6d6768f06b Update src/mlpack/methods/ann/activation_functions/multi_quadratic_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:39:01 -05:00
Adam KroppandRyan Curtin d99c88ecd8 Update src/mlpack/methods/ann/activation_functions/rectifier_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:30:40 -05:00
Adam KroppandRyan Curtin 18bac82267 Update src/mlpack/methods/ann/activation_functions/hard_sigmoid_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:29:12 -05:00
Adam KroppandRyan Curtin 1456ab9873 Update src/mlpack/methods/ann/activation_functions/hard_swish_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:28:48 -05:00
Adam KroppandRyan Curtin 8de759ebff Update src/mlpack/methods/ann/activation_functions/gelu_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:28:35 -05:00
Adam KroppandRyan Curtin 8f89db7fb6 Update src/mlpack/methods/ann/activation_functions/lisht_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:28:12 -05:00
Adam KroppandRyan Curtin bc94bb9b84 Update src/mlpack/methods/ann/activation_functions/mish_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:27:54 -05:00
Adam KroppandRyan Curtin 7846bc0623 Update src/mlpack/methods/ann/activation_functions/gaussian_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:27:34 -05:00
Adam KroppandRyan Curtin ae578a7347 Update src/mlpack/methods/ann/activation_functions/gaussian_function.hpp
Co-authored-by: Ryan Curtin <ryan@ratml.org>
2023-11-13 14:27:07 -05:00