Documentation

Hadoop Compiler

Package MATLAB programs for deployment to Hadoop clusters as MapReduce programs

expand all in page

Description

The Hadoop Compiler packages MATLAB® functions into applications for deployment to Hadoop® clusters as MapReduce programs.

Open the Hadoop Compiler App

  • MATLAB Toolstrip: On the Apps tab, under Application Deployment, click the app icon.

  • MATLAB command prompt: Enter hadoopCompiler.

Examples

Parameters

expand all

map function — function for mapperstring

Function for the mapper as a string.

reduce function — function for reducerstring

Function for the reducer as a string.

datastore file — input file for MapReducestring

Input file for MapReduce as a string.

output types — format of outputkeyvalue (default) | tabulartext

Format of MapReduce output as a string.

additional configuration file content — additional parameters configuring how Hadoop runs jobstring

Additional parameters to configure how Hadoop runs the job as a string. See Hadoop Settings File.

files required for your MapReduce job payload to run — files that must be included with generated artifactslist of files

Files that must be included with generated artifacts as a list of files.

Settings

Additional parameters passed to MCC — flags controlling the behavior of the compilerstring

Flags controlling the behavior of the compiler as a string.

testing files — folder where files for testing are storedstring

Folder where files for testing are stored as a string.

packaged files — folder where generated artifacts are storesstring

Folder where generated artifacts are stored as a string.

Programmatic Use

hadoopCompiler

Was this topic helpful?
MATLAB Compiler Documentation
Other Documentation
Support