broadcast

Class: matlab.compiler.mlspark.SparkContext
Namespace: matlab.compiler.mlspark

Broadcast a read-only variable to the cluster

expand all in page

Syntax

result = broadcast(sc,value)

Description

result = broadcast(sc,value) broadcasts a read-only variable value to the cluster initialized by SparkContext sc.

Input Arguments

expand all

`sc` — SparkContext to use
`SparkContext` object

The SparkContext to use, specified as a SparkContext object.

`value` — Value to be broadcast
any supported data type

The value to be broadcast, specified as any supported data type.

Output Arguments

expand all

`result` — Broadcast variable
`Broadcast` object

Broadcast variable, returned as a broadcast object with the following properties:

id
value
path

Examples

expand all

Broadcast a Variable

Broadcast a read-only variable to the cluster.

%% Connect to Spark
sparkProp = containers.Map({'spark.executor.cores'}, {'1'});
conf = matlab.compiler.mlspark.SparkConf('AppName','myApp', ...
                        'Master','local[1]','SparkProperties',sparkProp);
sc = matlab.compiler.mlspark.SparkContext(conf);

%% broadcast
myRdd = sc.parallelize({1,2,3,4,5});
myBroadcast = sc.broadcast('Hello, World');
newRdd = myRdd.map(@(x) myBroadcast.value);
countdata = newRdd.collect()