Class GridBasedEnumerator
- java.lang.Object
-
- org.apache.sysds.resource.enumeration.Enumerator
-
- org.apache.sysds.resource.enumeration.GridBasedEnumerator
-
public class GridBasedEnumerator extends Enumerator
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.sysds.resource.enumeration.Enumerator
Enumerator.Builder, Enumerator.EnumerationStrategy, Enumerator.OptimizationStrategy
-
-
Field Summary
-
Fields inherited from class org.apache.sysds.resource.enumeration.Enumerator
COST_DELTA_FRACTION, DEFAULT_MAX_EXECUTORS, DEFAULT_MIN_EXECUTORS, MAX_LEVEL_PARALLELISM
-
-
Constructor Summary
Constructors Constructor Description GridBasedEnumerator(Enumerator.Builder builder, int stepSizeExecutors, int expBaseExecutors)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description ArrayList<Integer>
estimateRangeExecutors(long executorMemory, int executorCores)
Estimates the minimum and maximum number of executors based on given VM instance characteristics and on the enumeration strategyboolean
evaluateSingleNodeExecution(long driverMemory)
void
preprocessing()
Initializes the pool for driver and executor instances parsed at processing with all the available instances-
Methods inherited from class org.apache.sysds.resource.enumeration.Enumerator
getDriverSpace, getExecutorSpace, getInstances, getSolutionPool, loadInstanceTableFile, postprocessing, processing, setDriverSpace, setExecutorSpace, setInstanceTable, setSolutionPool
-
-
-
-
Constructor Detail
-
GridBasedEnumerator
public GridBasedEnumerator(Enumerator.Builder builder, int stepSizeExecutors, int expBaseExecutors)
-
-
Method Detail
-
preprocessing
public void preprocessing()
Initializes the pool for driver and executor instances parsed at processing with all the available instances- Specified by:
preprocessing
in classEnumerator
-
evaluateSingleNodeExecution
public boolean evaluateSingleNodeExecution(long driverMemory)
- Specified by:
evaluateSingleNodeExecution
in classEnumerator
-
estimateRangeExecutors
public ArrayList<Integer> estimateRangeExecutors(long executorMemory, int executorCores)
Description copied from class:Enumerator
Estimates the minimum and maximum number of executors based on given VM instance characteristics and on the enumeration strategy- Specified by:
estimateRangeExecutors
in classEnumerator
- Parameters:
executorMemory
- memory of currently considered executor instanceexecutorCores
- CPU of cores of currently considered executor instance- Returns:
- - [min, max]
-
-