Documentation

parallel.cluster.Hadoop

Create Hadoop cluster object

collapse all in page

Syntax

  • hcluster = parallel.cluster.Hadoop
    example
  • hcluster = parallel.cluster.Hadoop(Name,Value)

Description

example

hcluster = parallel.cluster.Hadoop creates a parallel.cluster.Hadoop object representing the Hadoop® cluster.

You use the resulting object as input to the mapreducer function, for specifying the Hadoop cluster as the mapreduce parallel execution environment.

hcluster = parallel.cluster.Hadoop(Name,Value) uses the specified names and values to set properties on the created parallel.cluster.Hadoop object.

Examples

collapse all

Set Hadoop Cluster as mapreduce Execution Environment

This example shows how to create and use a parallel.cluster.Hadoop object to set a Hadoop cluster as the mapreduce parallel execution environment.

hcluster = parallel.cluster.Hadoop('HadoopInstallFolder','/host/hadoop-install');
mr = mapreducer(hcluster);

Related Examples

Input Arguments

collapse all

Name-Value Pair Arguments

Specify optional comma-separated pairs of Name,Value arguments. Name is the argument name and Value is the corresponding value. Name must appear inside single quotes (' '). You can specify several name and value pair arguments in any order as Name1,Value1,...,NameN,ValueN.

Example: 'HadoopInstallFolder','/share/hadoop/a1.2.1'

'ClusterMatlabRoot' — Path to MATLAB® for workerscharacter string

Path to MATLAB for workers, specified as the comma-separated pair consisting of 'ClusterMatlabRoot' and a character string. This points to the installation of MATLAB Distributed Computing Server™ for the workers, whether local to each machine or on a network share.

'HadoopConfigurationFile' — Path to Hadoop application configuration filecharacter string

Path to Hadoop application configuration file, specified as the comma-separated pair consisting of 'HadoopConfigurationFile' and a character string.

'HadoopInstallFolder' — Path to Hadoop installation on worker machinescharacter string

Path to Hadoop installation on worker machines, specified as the comma-separated pair consisting of 'HadoopInstallFolder' and a character string. If this property is not set, the default is the value specified by the environment variable HADOOP_PREFIX, or if that is not set, then HADOOP_HOME.

Output Arguments

collapse all

hcluster — Hadoop clusterparallel.cluster.Hadoop object

Hadoop cluster, returned as a parallel.cluster.Hadoop object.

See Also

|

Introduced in R2014b

Was this topic helpful?
Parallel Computing Toolbox Documentation
Other Documentation
Support