Package org.apache.sysds.runtime.controlprogram.parfor

Class RemoteParForSparkWorker

java.lang.Object

org.apache.sysds.runtime.controlprogram.parfor.ParWorker

org.apache.sysds.runtime.controlprogram.parfor.RemoteParForSparkWorker

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.PairFlatMapFunction<Task,Long,String>

public class RemoteParForSparkWorker
extends ParWorker
implements org.apache.spark.api.java.function.PairFlatMapFunction<Task,Long,String>

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor	Description
RemoteParForSparkWorker(long jobid, String program, boolean isLocal, HashMap<String,byte[]> clsMap, boolean cpCaching, org.apache.spark.util.LongAccumulator atasks, org.apache.spark.util.LongAccumulator aiters, Map<String,org.apache.spark.broadcast.Broadcast<CacheBlock<?>>> brInputs, boolean cleanCache, Map<String,String> lineage)

Method Summary

Modifier and Type	Method	Description
Iterator<scala.Tuple2<Long,String>>	call(Task arg0)
static void	cleanupCachedVariables(long pfid)

Methods inherited from class org.apache.sysds.runtime.controlprogram.parfor.ParWorker

getExecutedIterations, getExecutedTasks, getExecutionContext, getVariables

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RemoteParForSparkWorker

public RemoteParForSparkWorker(long jobid,
                               String program,
                               boolean isLocal,
                               HashMap<String,byte[]> clsMap,
                               boolean cpCaching,
                               org.apache.spark.util.LongAccumulator atasks,
                               org.apache.spark.util.LongAccumulator aiters,
                               Map<String,org.apache.spark.broadcast.Broadcast<CacheBlock<?>>> brInputs,
                               boolean cleanCache,
                               Map<String,String> lineage)

Method Detail

call

public Iterator<scala.Tuple2<Long,String>> call(Task arg0)
                                               throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.PairFlatMapFunction<Task,Long,String>

Throws:

Exception

cleanupCachedVariables

public static void cleanupCachedVariables(long pfid)