Run Standalone MATLAB MapReduce Applications Against a Hadoop Cluster

Create a standalone MATLAB® mapreduce application, and excute it against a Hadoop® cluster

A standalone MATLAB mapreduce application is a self-contained application encompassing all the necessary components for independent execution against a Hadoop cluster. It contains a:

  • mapper function (one or more) written in MATLAB.

  • reducer function written in MATLAB.

  • MATLAB application script or function invoking the mapper and reducer functions.

All components are packaged into a single standalone application to be executed against a Hadoop cluster. Standalone applications can be packaged using the Application Compiler app or from the MATLAB command prompt using the mcc command.

For more information, see Workflow to Run Compiled Standalone Applications Against a Hadoop Cluster.

Functions

deploytoolCompile and package functions for external deployment
mccCompile MATLAB functions for deployment
mapreduceProgramming technique for analyzing data sets that do not fit in memory
mapreducerDefine deployed execution for mapreduce

Classes

matlab.mapreduce.DeployHadoopMapReducerConfigure a MapReduce application for deployment against Hadoop

Topics

Workflow to Run Compiled Standalone Applications Against a Hadoop Cluster

Instructions on how to create a compiled standalone application and run it against a Hadoop cluster.

Examples

Example on Running a Standalone MATLAB MapReduce Application

Create a standalone MATLAB MapReduce application using the mcc command, and run it against a Hadoop cluster.

Related Information

MapReduce (MATLAB)

Datastore (MATLAB)

Was this topic helpful?