abstract class RuntimeConfig extends AnyRef
Runtime configuration interface for Spark. To access this, use SparkSession.conf.
Options set here are automatically propagated to the Hadoop configuration during I/O.
- Annotations
- @Stable()
- Since
2.0.0
- Alphabetic
- By Inheritance
- RuntimeConfig
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Instance Constructors
- new RuntimeConfig()
Abstract Value Members
- abstract def get(key: String, default: String): String
Returns the value of Spark runtime configuration property for the given key.
Returns the value of Spark runtime configuration property for the given key. If the key is not set yet, return the user given
default. This is useful when its default value defined by Apache Spark is not the desired one.- Since
2.0.0
- abstract def get(key: String): String
Returns the value of Spark runtime configuration property for the given key.
Returns the value of Spark runtime configuration property for the given key. If the key is not set yet, return its default value if possible, otherwise
NoSuchElementExceptionwill be thrown.- Annotations
- @throws("if the key is not set and there is no default value")
- Since
2.0.0
- Exceptions thrown
java.util.NoSuchElementExceptionif the key is not set and does not have a default value
- abstract def getAll: Map[String, String]
Returns all properties set in this conf.
Returns all properties set in this conf.
- Since
2.0.0
- abstract def getOption(key: String): Option[String]
Returns the value of Spark runtime configuration property for the given key.
Returns the value of Spark runtime configuration property for the given key. If the key is not set yet, return its default value if possible, otherwise
Nonewill be returned.- Since
2.0.0
- abstract def isModifiable(key: String): Boolean
Indicates whether the configuration property with the given key is modifiable in the current session.
Indicates whether the configuration property with the given key is modifiable in the current session.
- returns
trueif the configuration property is modifiable. For static SQL, Spark Core, invalid (not existing) and other non-modifiable configuration properties, the returned value isfalse.
- Since
2.4.0
- abstract def set(key: String, value: String): Unit
Sets the given Spark runtime configuration property.
Sets the given Spark runtime configuration property.
- Since
2.0.0
- abstract def unset(key: String): Unit
Resets the configuration property for the given key.
Resets the configuration property for the given key.
- Since
2.0.0
Concrete Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- def set(key: String, value: Long): Unit
Sets the given Spark runtime configuration property.
Sets the given Spark runtime configuration property.
- Since
2.0.0
- def set(key: String, value: Boolean): Unit
Sets the given Spark runtime configuration property.
Sets the given Spark runtime configuration property.
- Since
2.0.0
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated
(Since version 9)