matlab.mapreduce.DeployHadoopMapReducer class

Package: matlab.mapreduce

Configure a MapReduce application for deployment against Hadoop

Description

MapReducer object that represents executing MapReduce on a Hadoop® cluster with a deployed MATLAB® Runtime.

Construction

config = matlab.mapreduce.DeployHadoopMapReducer creates a matlab.mapreduce.DeployHadoopMapReducer object that specifies the default properties for Hadoop execution.

Use the resulting object as input to the mapreducer function, to specify the configuration properties for Hadoop execution. For deploying a standalone application, pass the matlab.mapreduce.DeployHadoopMapReducer object as input to mapreduce.

config = matlab.mapreduce.DeployHadoopMapReducer(Name,Value) creates a matlab.mapreduce.DeployHadoopMapReducer object with properties specified by one or more name-value pair arguments.

Input Arguments

expand all

Name-Value Pair Arguments

Specify optional comma-separated pairs of Name,Value arguments. Name is the argument name and Value is the corresponding value. Name must appear inside single quotes (' '). You can specify several name and value pair arguments in any order as Name1,Value1,...,NameN,ValueN.

Example: 'MCRRoot','/hd-shared/hadoop-2.2.0/MCR/v84'

'HadoopInstallFolder' — Path to Hadoop installationcharacter string

Path to Hadoop installation, specified as the comma-separated pair consisting of the HadoopInstallFolder and a character string.

The default value of Hadoop install folder is specified by the environment variables in the order of precedence of MATLAB_HADOOP_INSTALL, HADOOP_PREFIX, and HADOOP_HOME.

'HadoopConfigurationFile' — Path to Hadoop application configuration filescharacter string

Path to Hadoop application configuration files, specified as the comma-separated pair consisting of the HadoopConfigurationFile and a character string.

'MCRRoot' — MATLAB Runtime install folder for Hadoop clustercharacter string

MATLAB Runtime install folder for Hadoop cluster, specified as the comma-separated pair consisting of the MCRRoot and a character string.

MCRRoot specifies the MATLAB Runtime install folder used by Hadoop when executing mapreduce tasks in Hadoop.

'HadoopProperties' — Map container of name-value pairscharacter string | cell array of strings

Map container of name-value pairs, specified as the comma-separated pair consisting of the HadoopProperties and a character string or a cell array of strings.

Map container values are passed as inputs to the Hadoop command.

Properties

expand all

HadoopInstallFolderPath to Hadoop installationcharacter string

Path to Hadoop installation, specified as a character string.

HadoopConfigurationFilePath to Hadoop application configuration filescharacter string

Path to Hadoop application configuration files, specified as a character string.

MCRRootMATLAB Runtime install folder for Hadoop clustercharacter string

MATLAB Runtime install folder for Hadoop cluster, specified as a character string.

MCRRoot specifies the MATLAB Runtime install folder used by Hadoop when executing mapreduce tasks in Hadoop.

HadoopPropertiesMap container of name-value pairscharacter string | cell array of strings

Map container of name-value pairs, specified as a character string or a cell array of strings.

Map container values are passed as inputs to the Hadoop command.

Examples

expand all

Create a Deploy Hadoop MapReducer object

Create and use a matlab.mapreduce.DeployHadoopMapReducer object to deploy into a standalone application and deploy against Hadoop.

config = matlab.mapreduce.DeployHadoopMapReducer('MCRRoot',...
    '/hd-shared/hadoop-2.2.0/MCR/v84');
mr = mapreducer(config);

Related Examples

See Also

|

Was this topic helpful?