a fast, header-only machine learning library
Download:
current stable version (4.0.0)
**mlpack** is an intuitive, fast, and flexible header-only C++ machine learning
library with bindings to other languages. It is meant to be a machine learning
analog to LAPACK, and aims to implement a wide array of machine learning methods
and functions as a "swiss army knife" for machine learning researchers.
mlpack's lightweight C++ implementation makes it ideal for deployment, and it
can also be used for interactive prototyping via C++ notebooks (these can be
seen in action on mlpack's [homepage](https://www.mlpack.org/)).
In addition to its powerful C++ interface, mlpack also provides command-line
programs, Python bindings, Julia bindings, Go bindings and R bindings.
***Quick links:***
- Quickstart guides: [C++](doc/quickstart/cpp.md),
[CLI](doc/quickstart/cli.md), [Python](doc/quickstart/python.md),
[R](doc/quickstart/R.md), [Julia](doc/quickstart/julia.md),
[Go](doc/quickstart/go.md)
- [mlpack homepage](https://www.mlpack.org/)
- [mlpack documentation](https://www.mlpack.org/docs.html)
- [Examples repository](https://github.com/mlpack/examples/)
- [Tutorials](https://www.mlpack.org/doc/mlpack-git/doxygen/tutorials.html)
- [Development Site (Github)](https://www.github.com/mlpack/mlpack/)
[//]: # (numfocus-fiscal-sponsor-attribution)
mlpack uses an [open governance model](./GOVERNANCE.md) and is fiscally
sponsored by [NumFOCUS](https://numfocus.org/). Consider making a
[tax-deductible donation](https://numfocus.org/donate-to-mlpack) to help the
project pay for developer time, professional services, travel, workshops, and a
variety of other needs.
## 0. Contents and Quick Links
1. [Citation details](#1-citation-details)
2. [Dependencies](#2-dependencies)
3. [Installing and using mlpack in C++](#4-installing-and-using-mlpack-in-c++)
4. [Building mlpack bindings to other languages](#5-building-mlpack-bindings-to-other-languages)
1. [Command-line programs](#4i-command-line-programs)
2. [Python bindings](#4ii-python-bindings)
3. [R bindings](#4iii-r-bindings)
4. [Julia bindings](#4iv-julia-bindings)
5. [Go bindings](#4v-go-bindings)
5. [Building mlpack's test suite](#5-building-mlpacks-test-suite)
6. [Further resources](#6-further-resources)
## 1. Citation details
If you use mlpack in your research or software, please cite mlpack using the
citation below (given in BibTeX format):
@article{mlpack2018,
title = {mlpack 3: a fast, flexible machine learning library},
author = {Curtin, Ryan R. and Edel, Marcus and Lozhnikov, Mikhail and
Mentekidis, Yannis and Ghaisas, Sumedh and Zhang,
Shangtong},
journal = {Journal of Open Source Software},
volume = {3},
issue = {26},
pages = {726},
year = {2018},
doi = {10.21105/joss.00726},
url = {https://doi.org/10.21105/joss.00726}
}
Citations are beneficial for the growth and improvement of mlpack.
## 2. Dependencies
mlpack requires a C++14 compiler and has the following additional dependencies:
- Armadillo >= 9.800
- ensmallen >= 2.10.0
- cereal >= 1.1.2
If the STB library headers are available, image loading support will be
available.
If you are compiling Armadillo by hand, ensure that LAPACK and BLAS are enabled.
## 3. Installing and using mlpack in C++
*See also the [C++ quickstart](doc/quickstart/cpp.md).*
Since mlpack is a header-only library, installing just the headers for use in a
C++ application is trivial. From the root of the sources, configure and install
in the standard CMake way:
```sh
mkdir build && cd build/
cmake ../
sudo make install
```
You can add a few arguments to the `cmake` command to control the behavior of
the configuration and build process. Simply add these to the `cmake` command.
Some options are given below:
- `-DCMAKE_INSTALL_PREFIX=/install/root/` will set the root of the install
directory to `/install/root` when `make install` is run.
- `-DDOWNLOAD_DEPENDENCIES=ON` will automatically download mlpack's
dependencies (ensmallen, Armadillo, and cereal).
- `-DDEBUG=ON` will enable debugging symbols in any compiled bindings or tests.
There are also options to enable building bindings to each language that mlpack
supports; those are detailed in the following sections.
Once headers are installed with `make install`, using mlpack in an application
consists only of including it. So, your program should include mlpack:
```c++
#include
```
and when you link, be sure to link against Armadillo. If your example program
is `my_program.cpp`, your compiler is GCC, and you would like to compile with
OpenMP support (recommended) and optimizations, compile like this:
```sh
g++ -O3 -std=c++14 -o my_program my_program.cpp -larmadillo -fopenmp
```
Note that if you want to serialize (save or load) neural networks, you should
add `#define MLPACK_ENABLE_ANN_SERIALIZATION` before including ``.
See the [C++ quickstart](doc/quickstart/cpp.md) and the
[examples](https://github.com/mlpack/examples) repository for some examples of
mlpack applications in C++, with corresponding `Makefile`s.
### 3.1. Including mlpack and improving compile time
mlpack is a template-heavy library, and if care is not used, compilation time of
a project can be increased greatly. Fortunately, there are a number of ways to
reduce compilation time:
* Include individual headers, like ``, if you
are only using one component, instead of ``. This reduces the
amount of work the compiler has to do.
* Only use the `MLPACK_ENABLE_ANN_SERIALIZATION` definition if you are
serializing neural networks in your code. When this define is enabled,
compilation time will increase significantly, as the compiler must generate
code for every possible type of layer.
* If you are using mlpack in multiple .cpp files, consider using [`extern
templates`](https://isocpp.org/wiki/faq/cpp11-language-templates) so that the
compiler only instantiates each template once; add an explicit template
instantiation for each mlpack template type you want to use in a .cpp file,
and then use `extern` definitions elsewhere to let the compiler know it
exists in a different file.
Other strategies exist too, such as precompiled headers, compiler options,
[`ccache`](https://ccache.dev), and others.
## 4. Building mlpack bindings to other languages
mlpack is not just a header-only library: it also comes with bindings to a
number of other languages, this allows flexible use of mlpack's efficient
implementations from languages that aren't C++.
In general, you should *not* need to build these by hand---they should be
provided by either your system package manager or your language's package
manager.
Building the bindings for a particular language is done by calling `cmake` with
different options; each example below shows how to configure an individual set
of bindings, but it is of course possible to combine the options and build
bindings for many languages at once.
### 4.i. Command-line programs
*See also the [command-line quickstart](doc/quickstart/cli.md).*
The command-line programs have no extra dependencies. The set of programs that
will be compiled is detailed and documented on the [command-line program
documentation page](https://www.mlpack.org/doc/stable/cli_documentation.html).
From the root of the mlpack sources, run the following commands to build and
install the command-line bindings:
```sh
mkdir build && cd build/
cmake -DBUILD_CLI_PROGRAMS=ON ../
make
sudo make install
```
You can use `make -j`, where `N` is the number of cores on your machine, to
build in parallel; e.g., `make -j4` will use 4 cores to build.
### 4.ii. Python bindings
*See also the [Python quickstart](doc/quickstart/python.md).*
mlpack's Python bindings are available on
[PyPI](https://pypi.org/project/mlpack) and
[conda-forge](https://conda-forge.org/packages/mlpack), and can be installed
with either `pip install mlpack` or `conda install -c conda-forge mlpack`.
These sources are recommended, as building the Python bindings by hand can be
complex.
With that in mind, if you would still like to manually build the mlpack Python
bindings, first make sure that the following Python packages are installed:
- setuptools
- cython >= 0.24
- numpy
- pandas >= 0.15.0
Now, from the root of the mlpack sources, run the following commands to build
and install the Python bindings:
```sh
mkdir build && cd build/
cmake -DBUILD_PYTHON_BINDINGS=ON ../
make
sudo make install
```
You can use `make -j`, where `N` is the number of cores on your machine, to
build in parallel; e.g., `make -j4` will use 4 cores to build. You can also
specify a custom Python interpreter with the CMake option
`-DPYTHON_EXECUTABLE=/path/to/python`.
### 4.iii. R bindings
*See also the [R quickstart](doc/quickstart/R.md).*
mlpack's R bindings are available as the R package
[mlpack](https://cran.r-project.org/web/packages/mlpack/index.html) on CRAN.
You can install the package by running `install.packages('mlpack')`, and this is
the recommended way of getting mlpack in R.
If you still wish to build the R bindings by hand, first make sure the following
dependencies are installed:
- R >= 4.0
- Rcpp >= 0.12.12
- RcppArmadillo >= 0.9.800.0
- RcppEnsmallen >= 0.2.10.0
- roxygen2
- testthat
- pkgbuild
These can be installed with `install.packages()` inside of your R environment.
Once the dependencies are available, you can configure mlpack and build the R
bindings by running the following commands from the root of the mlpack sources:
```sh
mkdir build && cd build/
cmake -DBUILD_R_BINDINGS=ON ../
make
sudo make install
```
You may need to specify the location of the R program in the `cmake` command
with the option `-DR_EXECUTABLE=/path/to/R`.
Once the build is complete, a tarball can be found under the build directory in
`src/mlpack/bindings/R/`, and then that can be installed into your R environment
with a command like `install.packages(mlpack_3.4.3.tar.gz, repos=NULL,
type='source')`.
### 4.iv. Julia bindings
*See also the [Julia quickstart](doc/quickstart/julia.md).*
mlpack's Julia bindings are available by installing the
[mlpack.jl](https://github.com/mlpack/mlpack.jl) package using
`Pkg.add("mlpack.jl")`. The process of building, packaging, and distributing
mlpack's Julia bindings is very nontrivial, so it is recommended to simply use
the version available in `Pkg`, but if you want to build the bindings by hand
anyway, you can configure and build them by running the following commands from
the root of the mlpack sources:
```sh
mkdir build && cd build/
cmake -DBUILD_JULIA_BINDINGS=ON ../
make
```
If CMake cannot find your Julia installation, you can add
`-DJULIA_EXECUTABLE=/path/to/julia` to the CMake configuration step.
Note that the `make install` step is not done above, since the Julia binding
build system was not meant to be installed directly. Instead, to use handbuilt
bindings (for instance, to test them), one option is to start Julia with
`JULIA_PROJECT` set as an environment variable:
```sh
cd build/src/mlpack/bindings/julia/mlpack/
JULIA_PROJECT=$PWD julia
```
and then `using mlpack` should work.
### 4.v. Go bindings
*See also the [Go quickstart](doc/quickstart/go.md).*
To build mlpack's Go bindings, ensure that Go >= 1.11.0 is installed, and that
the Gonum package is available. You can use `go get` to install mlpack for Go:
```sh
go get -u -d mlpack.org/v1/mlpack
cd ${GOPATH}/src/mlpack.org/v1/mlpack
make install
```
The process of building the Go bindings by hand is a little tedious, so
following the steps above is recommended. However, if you wish to build the Go
bindings by hand anyway, you can do this by running the following commands from
the root of the mlpack sources:
```sh
mkdir build && cd build/
cmake -DBUILD_GO_BINDINGS=ON ../
make
sudo make install
```
## 5. Building mlpack's test suite
mlpack contains an extensive test suite that exercises every part of the
codebase. It is easy to build and run the tests with CMake and CTest, as below:
```sh
mkdir build && cd build/
cmake -DBUILD_TESTS=ON ../
make
ctest .
```
If you want to test the bindings, too, you will have to adapt the CMake
configuration command to turn on the language bindings that you want to
test---see the previous sections for details.
## 6. Further Resources
More documentation is available for both users and developers.
***User documentation***:
- [File formats and loading data in mlpack](doc/user/formats.md)
- [Matrices in mlpack](doc/user/matrices.md)
- [Cross-Validation](doc/user/cv.md)
- [Hyper-parameter Tuning](doc/user/hpt.md)
- [Building mlpack from source on Windows](doc/user/build_windows.md)
- [Sample C++ ML App for Windows](doc/user/sample_ml_app.md)
- [Examples repository](https://github.com/mlpack/examples/)
***Tutorials:***
- [Alternating Matrix Factorization (AMF)](doc/tutorials/amf.md)
- [Artificial Neural Networks (ANN)](doc/tutorials/ann.md)
- [Approximate k-Furthest Neighbor Search (`approx_kfn`)](doc/tutorials/approx_kfn.md)
- [Collaborative Filtering (CF)](doc/tutorials/cf.md)
- [DatasetMapper](doc/tutorials/datasetmapper.md)
- [Density Estimation Trees (DET)](doc/tutorials/det.md)
- [Euclidean Minimum Spanning Trees (EMST)](doc/tutorials/emst.md)
- [Fast Max-Kernel Search (FastMKS)](doc/tutorials/fastmks.md)
- [Image Utilities](doc/tutorials/image.md)
- [k-Means Clustering](doc/tutorials/kmeans.md)
- [Linear Regression](doc/tutorials/linear_regression.md)
- [Neighbor Search (k-Nearest-Neighbors)](doc/tutorials/neighbor_search.md)
- [Range Search](doc/tutorials/range_search.md)
- [Reinforcement Learning](doc/tutorials/reinforcement_learning.md)
***Developer documentation***:
- [mlpack versions in code](doc/developer/version.md)
- [Writing an mlpack binding](doc/developer/iodoc.md)
- [mlpack Timers](doc/developer/timer.md)
- [mlpack automatic bindings to other languages](doc/developer/bindings.md)
- [The ElemType policy in mlpack](doc/developer/elemtype.md)
- [The KernelType policy in mlpack](doc/developer/kernels.md)
- [The MetricType policy in mlpack](doc/developer/metrics.md)
- [The TreeType policy in mlpack](doc/developer/trees.md)
To learn about the development goals of mlpack in the short- and medium-term
future, see the [vision document](https://www.mlpack.org/papers/vision.pdf).
If you have problems, find a bug, or need help, you can try visiting
the [mlpack help](https://www.mlpack.org/questions.html) page, or [mlpack on
Github](https://www.github.com/mlpack/mlpack/). Alternately, mlpack help can be
found on Matrix at `#mlpack`; see also the
[community](https://www.mlpack.org/community.html) page.