Packages

c

org.apache.spark.resource

ResourceProfileBuilder

class ResourceProfileBuilder extends AnyRef

Resource profile builder to build a ResourceProfile to associate with an RDD. A ResourceProfile allows the user to specify executor and task resource requirements for an RDD that will get applied during a stage. This allows the user to change the resource requirements between stages.

Annotations
@Evolving() @Since("3.1.0")
Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ResourceProfileBuilder
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new ResourceProfileBuilder()

Value Members

  1. def build(): ResourceProfile
  2. def clearExecutorResourceRequests(): ResourceProfileBuilder.this.type
  3. def clearTaskResourceRequests(): ResourceProfileBuilder.this.type
  4. def executorResources: Map[String, ExecutorResourceRequest]
  5. def executorResourcesJMap: Map[String, ExecutorResourceRequest]

    (Java-specific) gets a Java Map of resources to ExecutorResourceRequest

  6. def require(requests: TaskResourceRequests): ResourceProfileBuilder.this.type

    Add task resource requests

    Add task resource requests

    requests

    The detailed task resource requests, see TaskResourceRequest

    returns

    This ResourceProfileBuilder

  7. def require(requests: ExecutorResourceRequests): ResourceProfileBuilder.this.type

    Add executor resource requests

    Add executor resource requests

    requests

    The detailed executor resource requests, see ExecutorResourceRequests

    returns

    This ResourceProfileBuilder

  8. def taskResources: Map[String, TaskResourceRequest]
  9. def taskResourcesJMap: Map[String, TaskResourceRequest]

    (Java-specific) gets a Java Map of resources to TaskResourceRequest

  10. def toString(): String
    Definition Classes
    ResourceProfileBuilder → AnyRef → Any