Error Conditions

Using name parameterized queries requires all parameters to be named. Parameters missing names: <exprs>.

The INTO clause of EXECUTE IMMEDIATE is only valid for queries but the given statement is not a query: <sqlString>.

Nested EXECUTE IMMEDIATE commands are not allowed. Please ensure that the SQL query provided (<sqlString>) does not contain another EXECUTE IMMEDIATE command.

Dataset transformations and actions can only be invoked by the driver, not inside of other Dataset transformations; for example, dataset1.map(x => dataset2.values.count() * x) is invalid because the values transformation and count action cannot be performed inside of the dataset1.map transformation. For more information, see SPARK-28702.

Cannot update <table> field <fieldName> type:

MapObjects does not support the class <cls> as resulting collection.

Some values in field <pos> are incompatible with the column array type. Expected type <type>.

Another instance of this query was just started by a concurrent session.

Not allowed to create the permanent view <name> without explicitly assigning an alias for the expression <attr>.

Distinct window functions are not supported: <windowExpr>.

The <format> datasource does not support writing empty or nested empty schemas. Please make sure the data schema has at least one or more column(s).

The group aggregate pandas UDF <functionList> cannot be invoked together with as other, non-pandas aggregate functions.

Cannot use <type> for partition column.

Not allowed to implement multiple UDF interfaces, UDF class <className>.

Cannot call function <functionName> because named argument references are not enabled here. In this case, the named argument reference was <argument>. Set "spark.sql.allowNamedFunctionArguments" to "true" to turn on feature.

ALTER TABLE ALTER/CHANGE COLUMN is not supported for changing <table>'s column <originName> with type <originType> to <newName> with type <newType>.

<cmd> is not supported for v2 tables.

<cmd> is not supported, if you want to enable it, please set "spark.sql.catalogImplementation" to "hive".

Not supported command in JDBC catalog:

Non-grouping expression <expr> is provided as an argument to the |> AGGREGATE pipe operator but does not contain any aggregate function; please update it to include an aggregate function and then retry the query again.

Aggregate function <expr> is not allowed when using the pipe operator |> <clause> clause; please use the pipe operator |> AGGREGATE clause instead.

The correlated scalar subquery '<sqlExpr>' is neither present in GROUP BY, nor in an aggregate function. Add it to GROUP BY using ordinal position or wrap it in first() (or first_value) if you don't care which value you get.

Star (*) is not allowed in a select list when GROUP BY an ordinal position is used.

Don't support add file.

Unsupported arrow type <typeName>.

Cannot call the method "<methodName>" of the class "<className>".

The char/varchar type can't be used in the table schema. If you want Spark treat them as string type as same as Spark 3.0 and earlier, please set "spark.sql.legacy.charVarcharAsString" to "true".

Collation <collationName> is not supported for:

Feature is not supported in Spark Connect:

Unsupported data source type for direct query on files: <dataSourceType>

Unsupported data type <typeName>.

The data source "<source>" cannot be written in the <createMode> mode. Please use either the "Append" or "Overwrite" mode instead.

The <format> datasource doesn't support the column <columnName> of the type <columnType>.

Cannot create encoder for <dataType>. Please use a different output data type for your UDF or DataFrame.

DEFAULT column values is not supported.

The deserializer is not supported:

The feature is not supported:

Unsupported join type '<typ>'. Supported join types include: <supported>.

Unsupported partition transform: <transform>. The supported transforms are identity, bucket, and clusterBy. Ensure your transform expression uses one of these.

The save mode <saveMode> is not supported for:

Unsupported a SHOW CREATE TABLE command.

The single-pass analyzer cannot process this query or command because it does not yet support <feature>.

<outputMode> output mode not supported for <statefulOperator> on streaming DataFrames/DataSets without watermark.

Unsupported subquery expression:

Literals of the type <unsupportedType> are not supported. Supported types are <supportedTypes>.

Renaming a <type> across schemas is not allowed.

Boolean statement <invalidStatement> is invalid. Expected single row with a value of the BOOLEAN type, but got an empty row.

More than one row returned by a subquery used as a row.

More than one row returned by a subquery used as an expression.

Cannot create view <viewName>, the reason is

Cannot write to <tableName>, the reason is

Cannot write to '<tableName>', <reason>: Table columns: <tableColumns>. Partition columns with static values: <staticPartCols>. Data columns: <dataColumns>.

Sketches have different lgConfigK values: <left> and <right>. Set the allowDifferentLgConfigK parameter to true to call <function> with different lgConfigK values.

Invalid value found when performing <function> with <charset>

<message>.<alternative> If necessary set <config> to "false" to bypass this error.

<value1> <symbol> <value2> caused overflow. Use <functionName> to ignore overflow problem and return NULL.

The value <value> of the type <sourceType> cannot be cast to <targetType> due to an overflow. Use try_cast to tolerate overflow and return NULL instead.

Fail to assign a value of <sourceType> type to the <targetType> type column or variable <columnName> due to an overflow. Use try_cast on the input value to tolerate overflow and return NULL instead.

Column ordinal out of bounds. The number of columns in the table is <attributesLength>, but the column ordinal is <ordinal>. Attributes are the following: <attributes>.

Decimal precision <precision> exceeds max precision <maxPrecision>.

Max offset with <rowsPerSecond> rowsPerSecond is <maxSeconds>, but 'rampUpTimeSeconds' is <rampUpTimeSeconds>.

The index <indexValue> is out of bounds. The array has <arraySize> elements. Use the SQL function get() to tolerate accessing element at invalid index and return NULL instead.

The index <indexValue> is out of bounds. The array has <arraySize> elements. Use try_element_at to tolerate accessing element at invalid index and return NULL instead.

The 0-indexed bitmap position <bitPosition> is out of bounds. The bitmap has <bitmapNumBits> bits (<bitmapNumBytes> bytes).

The boundary <boundary> is invalid: <invalidValue>.

The index 0 is invalid. An index shall be either < 0 or > 0 (the first element has index 1).

Numeric literal <rawStrippedQualifier> is outside the valid range for <typeName> with minimum value of <minValue> and maximum value of <maxValue>. Please adjust the value accordingly.

Found the negative value in <frequencyExpression>: <negativeValue>, but expected a positive integral value.

The value <value> cannot be interpreted as a numeric since it has more than 38 digits.

The sum of the LIMIT clause and the OFFSET clause must not be greater than the maximum 32-bit integer value (2,147,483,647) but found limit = <limit>, offset = <offset>.

The comparator has returned a NULL for a comparison between <firstValue> and <secondValue>. It should return a positive integer for "greater than", 0 for "equal" and a negative integer for "less than". To revert to deprecated behavior where NULL is treated as 0 (equal), you must set "spark.sql.legacy.allowNullComparisonResultInArraySort" to "true".

Execute immediate requires a non-null variable as the query string, but the provided variable <varName> is null.

Due to Scala's limited support of tuple, empty tuple is not supported.

Unable to parse <intervalString>. Please ensure that the value provided is in a valid format for defining an interval. You can reference the documentation for the correct format. If the issue persists, please double check that the input value is not null or empty and try again.

Error parsing '<input>' to interval. Please ensure that the value provided is in a valid format for defining an interval. You can reference the documentation for the correct format.

Cannot add an interval to a date because its microseconds part is not 0. If necessary set <ansiConfig> to "false" to bypass this error.

<message>. Use try_to_timestamp to tolerate invalid input string and return NULL instead.

Unrecognized datetime pattern: <pattern>.

Datetime operation overflow: <operation>.

Illegal input for day of week: <string>.

The timezone: <timeZone> is invalid. The timezone must be either a region-based zone ID or a zone offset. Region IDs must have the form 'area/city', such as 'America/Los_Angeles'. Zone offsets must be in the format '(+|-)HH', '(+|-)HH:mm’ or '(+|-)HH:mm:ss', e.g '-08' , '+01:00' or '-13:33:33', and must be in the range from -18:00 to +18:00. 'Z' and 'UTC' are accepted as synonyms for '+00:00'.

Cannot use null as map key.

Division by zero. Use try_divide to tolerate divisor being 0 and return NULL instead. If necessary set <config> to "false" to bypass this error.

Division by zero. Use try_divide to tolerate divisor being 0 and return NULL instead.

Integer overflow while operating with intervals.

Cannot parse decimal. Please ensure that the input is a valid number with optional decimal point or comma separators.

Error parsing descriptor bytes into Protobuf FileDescriptorSet.

The value <expression> of the type <sourceType> cannot be cast to <targetType> because it is malformed. Correct the value as per the syntax, or change its target type. Use try_cast to tolerate malformed input and return NULL instead.

The value <str> (<fmt>) cannot be converted to <targetType> because it is malformed. Correct the value as per the syntax, or change its format. Use <suggestion> to tolerate malformed input and return NULL instead.

Failed parsing struct: <raw>.

Input row doesn't have expected number of values required by the schema. <expected> fields are required while <actual> values are provided.

The value '<confValue>' in the config "<confName>" is invalid.

<rangeMessage>. If necessary set <ansiConfig> to "false" to bypass this error.

Valid range for seconds is [0, 60] (inclusive), but the provided value is <secAndMicros>. To avoid this error, use try_make_timestamp, which returns NULL on error. If you do not want to use the session default timestamp version of this function, use try_make_timestamp_ntz or try_make_timestamp_ltz.

Detected an invalid type of a JSON record while inferring a common schema in the mode <failFastMode>. Expected a STRUCT type, but found <invalidType>.

The value of parameter(s) <parameter> in <functionName> is invalid:

Could not perform regexp_replace for source = "<source>", pattern = "<pattern>", replacement = "<replacement>" and position = <position>.

The variant value <value> cannot be cast into <dataType>. Please use try_variant_get instead.

Invalid variant.

The path <path> is not a valid variant extraction path in <functionName>. A valid path should start with $ and is followed by zero or more segments like [123], .name, ['name'], or ["name"].

The schema <schema> is not a valid variant shredding schema.

Malformed records are detected in record parsing: <badRecord>. Parse Mode: <failFastMode>. To process malformed records as null result, try setting the option 'mode' as 'PERMISSIVE'.

Variant binary is malformed. Please check the data source is valid.

Found NULL in a row at the index <index>, expected a non-NULL value.

Not found an id for the rule name "<ruleName>". Please modify RuleIdCollection.scala if you are adding a new rule.

The second argument of <functionName> function needs to be an integer.

Failed to evaluate the table function <functionName> because its table metadata <requestedMetadata>, but the function call <invalidFunctionCallProperty>.

Failed to evaluate the table function <functionName> because its table metadata was invalid; <reason>.

Unknown primitive type with id <id> was found in a variant value.

Cannot construct a Variant larger than 16 MiB. The maximum allowed size of a Variant value is 16 MiB.

Failed to build variant because of a duplicate object key <key>.

Cannot build variant bigger than <sizeLimit> in <functionName>. Please avoid large input strings to this expression (for example, add function calls(s) to check the expression size and convert it to NULL first if it is too big).

Data source read/write option <option> cannot have null value.

Invalid UTF8 byte sequence found in string: <str>.

Cannot convert JSON root field to target Spark type.

Input schema <jsonSchema> can only contain STRING as a key type for a MAP.

Cannot parse the field name <fieldName> and the value <fieldValue> of the JSON token type <jsonType> to target Spark data type <dataType>.

Failed to convert the row value <value> of the class <class> to the target SQL type <sqlType> in the JSON format.

Failed to convert the JSON string '<invalidType>' to a data type. Please enter a valid data type.

Collations can only be applied to string types, but the JSON data type is <jsonType>.

The provided URL cannot be decoded: <url>. Please ensure that the URL is properly formatted and try again.

Invalid call to <function>; only valid HLL sketch buffers are supported as inputs (such as those produced by the hll_sketch_agg function).

Invalid call to <function>; the lgConfigK value must be between <min> and <max>, inclusive: <value>.

Boolean statement is expected in the condition, but <invalidStatement> was found.

Cannot convert Avro <avroPath> to SQL <sqlPath> because the original encoded data type is <avroType>, however you're trying to read the field as <sqlType>, which would lead to an incorrect answer. To allow reading this field, enable the SQL configuration: "spark.sql.legacy.avro.allowIncompatibleSchema".

Cannot call the <functionName> SQL function because the Avro data source is not loaded. Please restart your job or session with the 'spark-avro' package loaded, such as by using the --packages argument on the command line, and then retry your query or command again.

Cannot load Kryo serialization codec. Kryo serialization cannot be used in the Spark Connect client. Use Java serialization, provide a custom Codec, or use Spark Classic instead.

Cannot call the <functionName> SQL function because the Protobuf data source is not loaded. Please restart your job or session with the 'spark-protobuf' package loaded, such as by using the --packages argument on the command line, and then retry your query or command again.

The url is invalid: <url>. Use try_parse_url to tolerate invalid URL and return NULL instead.

The expected format is ByteString, but was <unsupported> (<class>).

Duplicate map key <key> was found, please check the input data. If you want to remove the duplicated keys, you can set <mapKeyDedupPolicy> to "LAST_WIN" so that the key inserted at last takes precedence.

Found duplicate keys <keyColumn>.

The ON search condition of the MERGE statement matched a single row from the target table with multiple rows of the source table. This could result in the target row being operated on more than once with an update or delete operation and is not allowed.

Cannot drop a schema <schemaName> because it contains objects. Use DROP SCHEMA ... CASCADE to drop the schema and all its objects.

<className> must override either <method1> or <method2>.

Failed preparing of the function <funcName> for call. Please, double check function's arguments.

Failed to load routine <routineName>.

Function <funcName> does not implement a ScalarFunction or AggregateFunction.

UDF class <className> doesn't implement any UDF interface.

Failed to <action> Python data source <type>: <msg>

Failed when Python streaming data source perform <action>: <msg>

Failed to analyze the Python user defined table function: <msg>

User defined function (<functionName>: (<signature>) => <result>) failed due to: <reason>.

An error occurred in the user provided function in flatMapGroupsWithState. Reason: <reason>

An error occurred in the user provided function in foreach batch sink. Reason: <reason>

An error occurred in the user provided function in foreach sink. Reason: <reason>

Database name is not specified in the v1 session catalog. Please ensure to provide a valid database name when interacting with the v1 catalog.

Concurrent update to the log. Multiple streaming jobs detected for <batchId>. Please make sure only one streaming job runs on a specific checkpoint location at a time.

Ambiguous reference to the field <field>. It appears <count> times in the schema.

Cannot remove reserved property: <property>.

'<operation>' does not support clustering.

Column or field <name> is of type <type> while it's required to be <expectedType>.

Can't extract a value from <base>. Need a complex type [STRUCT, ARRAY, MAP] but got <other>.

Field name should be a non-null string literal, but it's <extraction>.

Field name <fieldName> is invalid: <path> is not a struct.

Invalid inline table.

Expected format is 'RESET' or 'RESET key'. If you want to include special characters in key, please use quotes, e.g., RESET key.

The specified save mode <mode> is invalid. Valid save modes include "append", "overwrite", "ignore", "error", "errorifexists", and "default".

Expected format is 'SET', 'SET key', or 'SET key=value'. If you want to include special characters in key, or include semicolon in value, please use backquotes, e.g., SET key=value.

Invalid SQL syntax:

Invalid usage of <elem> in <prettyName>.

The requested write distribution is invalid.

<clause1> and <clause2> cannot coexist in the same SQL pipe operator using '|>'. Please separate the multiple result clauses into separate pipe operators and then retry the query again.

PARTITION clause cannot contain the non-partition column: <columnName>.

NULL value appeared in non-nullable field: <walkedTypePath>If the schema is inferred from a Scala tuple/case class, or a Java bean, please try to use scala.Option[_] or other nullable types (such as java.lang.Integer instead of int/scala.Int).

Assigning a NULL is not allowed here.

No handler for UDAF '<functionName>'. Use sparkSession.udf.register(...) instead.

Column or field <name> is nullable while it's required to be non-nullable.

Row ID attributes cannot be nullable: <nullableRowIdAttrs>.

Partition column <column> not found in schema <schema>. Please provide the existing column for partitioning.

Found an invalid agnostic encoder. Expects an instance of AgnosticEncoder but got <encoderType>. For more information consult '<docroot>/api/java/index.html?org/apache/spark/sql/Encoder.html'.

Found an invalid expression encoder. Expects an instance of ExpressionEncoder but got <encoderType>. For more information consult '<docroot>/api/java/index.html?org/apache/spark/sql/Encoder.html'.

Column aliases are not allowed in <op>.

<identifier> is not a valid identifier as it has more than 2 name parts.

Duplicated IDENTITY column sequence generator option: <sequenceGeneratorOption>.

Illegal value provided to the State Store

Syntax error in the attribute name: <name>. Check that backticks appear in pairs, a quoted string is a complete name part and use a backtick only inside quoted name parts.

Cannot use <type> for bucket column. Collated data types are not supported for bucketing.

Cannot extract <field> from <expr>.

The format is invalid: <format>.

The partition command is invalid.

The statement or clause: <operation> is not valid.

Cannot specify ORDER BY or a window frame for <aggFunc>.

LOCAL must be used together with the schema of file, but got: <actualSchema>.

There must be at least one WHEN clause in a MERGE statement.

Not allowed in the FROM clause:

Not allowed in the pipe WHERE clause:

The expression <expr> used for the routine or clause <name> must be a constant STRING which is NOT NULL.

Unresolved encoder expected, but <attr> was found.

The function <funcName> doesn't support the <mode> mode. Acceptable modes are PERMISSIVE and FAILFAST.

Syntax error at or near <error>``<hint>.

References to DEFAULT column values are not allowed within the PARTITION clause.

sortBy must be used together with bucketBy.

A CREATE TABLE without explicit column list cannot specify bucketing information. Please use the form with explicit column list and specify bucketing information. Alternatively, allow bucketing information to be inferred by omitting the clause.

A CREATE TABLE without explicit column list cannot specify PARTITIONED BY. Please use the form with explicit column list and specify PARTITIONED BY. Alternatively, allow partitioning to be inferred by omitting the PARTITION BY clause.

'<optionName>' must be specified.

Support of the clause or keyword: <clause> has been discontinued in this context.

Trailing comma detected in SELECT clause. Remove the trailing comma before the FROM clause.

Found an unclosed bracketed comment. Please, append */ at the end of the comment.

Window function <funcName> requires an OVER clause.

writeStream can be called only on streaming Dataset/DataFrame.

Cannot have circular references in class, but got the circular reference of class <t>.

CTE definition can't have duplicate names: <duplicateNames>.

Invalid value for delimiter.

The unquoted identifier <ident> is invalid and must be back quoted as: <ident>. Unquoted identifiers can only contain ASCII letters ('a' - 'z', 'A' - 'Z'), digits ('0' - '9'), and underbar ('_'). Unquoted identifiers must also not start with a digit. Different data sources and meta stores may impose additional restrictions on valid identifiers.

<key> is an invalid property key, please use quotes, e.g. SET <key>=<value>.

<value> is an invalid property value, please use quotes, e.g. SET <key>=<value>

<name> is not a valid name for tables/schemas. Valid names only contain alphabet characters, numbers and _.

Invalid as-of join.

Failed to parse an empty string for data type <dataType>.

Found an invalid escape string: <invalidEscape>. The escape string must contain only one character.

EscapeChar should be a string literal of length one, but got <sqlExpr>.

The value of the typed literal <valueType> is invalid: <value>.

The <functionName> requires <expectedNum> parameters but the actual number is <actualNum>.

It is not allowed to use an aggregate function in the argument of another aggregate function. Please use the inner aggregate function in a sub-query.

A DEFAULT keyword in a MERGE, INSERT, UPDATE, or SET VARIABLE command could not be directly assigned to a target column because it was part of an expression. For example: UPDATE SET c1 = DEFAULT is allowed, but UPDATE T SET c1 = DEFAULT + 1 is not allowed.

Can't determine the default value for <colName> since it is not nullable and it has no default value.

Watermark needs to be defined to reassign event time column. Failed to find watermark definition in the streaming query.

IDENTITY column step cannot be 0.

The join types <joinType1> and <joinType2> are incompatible.

Invalid join type in joinWith: <joinType>.

The <joinType> JOIN with LATERAL correlation is not allowed because an OUTER subquery cannot correlate to its join partner. Remove the LATERAL correlation or use an INNER JOIN, or LEFT OUTER JOIN instead.

Parameterized query must either use positional, or named parameters, but not both.

The singleVariantColumn option cannot be used if there is also a user specified schema.

When there are more than one MATCHED clauses in a MERGE statement, only the last MATCHED clause can omit the condition.

When there are more than one NOT MATCHED BY SOURCE clauses in a MERGE statement, only the last NOT MATCHED BY SOURCE clause can omit the condition.

When there are more than one NOT MATCHED [BY TARGET] clauses in a MERGE statement, only the last NOT MATCHED [BY TARGET] clause can omit the condition.

The options <options> cannot be specified together. Please specify the one.

Found duplicate clauses: <clauseName>. Please, remove one of them.

The <clause> clause may be used at most once per <operation> operation.

Invalid value for source option '<optionName>':

Syntax error, unexpected empty statement.

Cannot create generated column <fieldName> with generation expression <expressionStr> because <reason>.

Failed to execute <statementType> command because DEFAULT values are not supported when adding new columns to previously existing target data source with table provider: "<dataSource>".

Failed to execute <statementType> command because DEFAULT values are not supported for target data source with table provider: "<dataSource>".

A column cannot have both a default value and a generation expression but column <colName> has default value: (<defaultValue>) and generation expression: (<genExpr>).

A column cannot have both a default value and an identity column specification but column <colName> has default value: (<defaultValue>) and identity column specification: (<identityColumnSpec>).

Failed to execute <statement> command because the destination column or variable <colName> has a DEFAULT value <defaultValue>,

The columns or variables <nameList> appear more than once as assignment targets.

The USING clause of this EXECUTE IMMEDIATE command contained multiple arguments with same alias (<aliases>), which is invalid; please update the command to specify unique aliases and then try it again.

Column or field <name> is ambiguous and has <n> matches.

Column <name> is ambiguous. It's because you joined several DataFrame together, and some of these DataFrames are the same. This column points to one of the DataFrames but Spark is unable to figure out which one. Please alias the DataFrames with different names via DataFrame.alias before joining them, and specify the column using qualified name, e.g. df.alias("a").join(df.alias("b"), col("a.id") > col("b.id")).

Lateral column alias <name> is ambiguous and has <n> matches.

Columns in an EXCEPT list must be distinct and non-overlapping, but got (<columns>).

<colType> column <colName> is not defined in table <tableName>, defined table columns are: <tableCols>.

The column <colName> cannot be found. Verify the spelling and correctness of the column name according to the SQL config <caseSensitiveConfig>.

A column, variable, or function parameter with name <objectName> cannot be resolved.

A field with name <fieldName> cannot be resolved with the struct-type column <columnPath>.

Cannot resolve column <objectName> as a map key. If the key is a string literal, add the single quotes '' around it.

USING column <colName> cannot be resolved on the <side> side of the join. The <side>-side columns: [<suggestion>].

Reference <name> is ambiguous, could be: <referenceNames>.

Cannot resolve dataframe column <name>. It's probably because of illegal references like df1.select(df2.col("a")).

Cannot resolve <targetString>.* given input columns <columns>. Please check that the specified table or struct exists and is accessible in the input columns.

Cannot find a short name for the codec <codecName>.

The value <collationName> does not represent a correct collation name. Suggested valid collation names: [<proposals>].

The value <provider> does not represent a correct collation provider. Supported providers are: [<supportedProviders>].

Data source '<provider>' not found. Please make sure the data source is registered.

Default database <defaultDatabase> does not exist, please create it first or change default database to <defaultDatabase>.

Not found an encoder of the type <typeName> to Spark SQL internal representation. Consider to change the input type to one of supported at '<docroot>/sql-ref-datatypes.html'.

No such struct field <fieldName> in <fields>.

Cannot find the index <indexName> on table <tableName>.

The schema <schemaName> cannot be found. Verify the spelling and correctness of the schema and catalog. If you did not qualify the name with a catalog, verify the current_schema() output, or qualify the name with the correct catalog. To tolerate the error on drop use DROP SCHEMA IF EXISTS.

Unrecognized SQL type - name: <typeName>, id: <jdbcType>.

The statistic <stats> is not recognized. Valid statistics include count, count_distinct, approx_count_distinct, mean, stddev, min, max, and percentile values. Percentile must be a numeric value followed by '%', within the range 0% to 100%.

ALTER TABLE <type> column <columnName> specifies descriptor "<optionName>" more than once, which is invalid.

CREATE TABLE column <columnName> specifies descriptor "<optionName>" more than once, which is invalid.

Data source '<provider>' already exists. Please choose a different name for the new data source.

The metric name is not unique: <metricName>. The same name cannot be used for metrics with different results. However multiple instances of metrics with with same result and name are allowed (e.g. self-joins).

Cannot <op> column, because <fieldNames> already exists in <struct>.

Detected multiple data sources with the name '<provider>'. Please check the data source isn't simultaneously registered and located in the classpath.

Cannot create the index <indexName> on table <tableName> because it already exists.

Cannot name the managed table as <identifier>, as its associated location <location> already exists. Please pick a different table name, or remove the existing location first.

Detected multiple data sources with the name <provider> (<sourceNames>). Please specify the fully qualified class name or remove <externalSource> from the classpath.

The column <columnName> already exists. Choose another name or rename the existing column.

Duplicated field names in Arrow Struct are not allowed, got <fieldNames>.

Static partition column <staticName> is also specified in the column list.

Cannot create the <newRoutineType> <routineName> because a <existingRoutineType> of that name already exists. Choose a different name, drop or replace the existing <existingRoutineType>, or add the IF NOT EXISTS clause to tolerate a pre-existing <newRoutineType>.

Cannot create the variable <variableName> because it already exists. Choose a different name, or drop or replace the existing variable.

Call to routine <routineName> is invalid because it includes multiple argument assignments to the same parameter name <parameterName>.

Named parameters are not supported for function <functionName>; please retry the query with positional arguments to the function call instead.

Cannot invoke routine <routineName> because the parameter named <parameterName> is required, but the routine call did not supply a value. Please update the routine call to supply an argument value (either positionally at index <index> or by name) and retry the query again.

Cannot invoke routine <routineName> because it contains positional argument(s) following the named argument assigned to <parameterName>; please rearrange them so the positional arguments come first and then retry the query again.

Cannot invoke routine <routineName> because the routine call included a named argument reference for the argument named <argumentName>, but this routine does not include any signature containing an argument with this name. Did you mean one of the following? [<proposal>].

The number of columns or variables assigned or aliased: <numTarget> does not match the number of source expressions: <numExpr>.

Failed to perform stateful processor operation=<operationType> with invalid handle state=<handleState>.

Failed to perform stateful processor operation=<operationType> with invalid timeMode=<timeMode>

State variable with name <stateVarName> has already been defined in the StatefulProcessor.

Cannot use TTL for state=<stateName> in timeMode=<timeMode>, use TimeMode.ProcessingTime() instead.

TTL duration must be greater than zero for State store operation=<operationType> on state=<stateName>.

Unknown time mode <timeMode>. Accepted timeMode modes are 'none', 'processingTime', 'eventTime'

Failed to create column family with unsupported starting character and name=<colFamilyName>.

Failed to perform column family operation=<operationName> with invalid name=<colFamilyName>. Column family name cannot be empty or include leading/trailing spaces or use the reserved keyword=default

Incompatible schema transformation with column family=<colFamilyName>, oldSchema=<oldSchema>, newSchema=<newSchema>.

The handle has not been initialized for this StatefulProcessor. Please only use the StatefulProcessor within the transformWithState operator.

Incorrect number of ordering ordinals=<numOrderingCols> for range scan encoder. The number of ordering ordinals cannot be zero or greater than number of schema columns.

Incorrect number of prefix columns=<numPrefixCols> for prefix scan encoder. Prefix columns cannot be zero or greater than or equal to num of schema columns.

Null type ordering column with name=<fieldName> at index=<index> is not supported for range scan encoder.

State store operation=<operationType> not supported on missing column family=<colFamilyName>.

Variable size ordering column with name=<fieldName> at index=<index> is not supported for range scan encoder.

The number of aliases supplied in the AS clause does not match the number of columns output by the UDTF. Expected <aliasesSize> aliases, but got <aliasesNames>. Please ensure that the number of aliases provided matches the number of columns output by the UDTF.

Failed to evaluate the user-defined table function because its 'analyze' method returned a requested OrderingColumn whose column name expression included an unnecessary alias <aliasName>; please remove this alias and then try the query again.

Failed to evaluate the user-defined table function because its 'analyze' method returned a requested 'select' expression (<expression>) that does not include a corresponding alias; please update the UDTF to specify an alias there and then try the query again.

Column of grouping (<grouping>) can't be found in grouping columns <groupingColumns>.

Columns of grouping_id (<groupingIdColumn>) does not match grouping columns (<groupByColumns>).

The non-aggregating expression <expression> is based on columns which are not participating in the GROUP BY clause. Add the columns or the expression to the GROUP BY, aggregate the expression, or use <expressionAnyValue> if you do not care which of the values within a group is returned.

The query does not include a GROUP BY clause. Add GROUP BY or turn it into the window functions using OVER clauses.

Cannot infer grouping columns for GROUP BY ALL based on the select clause. Please explicitly specify the grouping columns.

The column <columnName> for corrupt records must have the nullable STRING type, but got <actualType>.

Invalid index column for TRANSPOSE because: <reason>

GROUP BY position <index> is not in select list (valid range is [1, <size>]).

ORDER BY position <index> is not in select list (valid range is [1, <size>]).

'<operation>' expects a permanent view but <viewName> is a temp view.

'<operation>' expects a table but <viewName> is a view.

The table <tableName> does not support <operation>.

The operation <statement> is not allowed on the <objectType>: <objectName>.

Operation <operation> is not allowed for <tableIdentWithDB> because it is not a partitioned table.

Can't insert into the target.

The operation <operation> requires a <requiredType>. But <objectName> is a <foundType>. Use <alternative> instead.

Previous node emitted a row with eventTime=<emittedRowEventTime> which is older than current_watermark_value=<currentWatermark> This can lead to correctness issues in the stateful operators downstream in the execution pipeline. Please correct the operator logic to emit rows after current global watermark value.

Invalid pivot column <columnName>. Pivot columns must be comparable.

Column expression <expr> cannot be sorted because its type <exprType> is not orderable.

The expression <sqlExpr> cannot be used as a grouping expression because its data type <dataType> is not an orderable data type.

Invalid subquery:

Failed to merge incompatible data types <left> and <right>. Please check the data types of the columns being merged and ensure that they are compatible. If necessary, consider casting the columns to compatible data types before attempting the merge.

<operator> can only be performed on tables with compatible column types. The <columnOrdinalNumber> column of the <tableOrdinalNumber> table is <dataType1> type which is not compatible with <dataType2> at the same column of the first table.<hint>.

<operator> can only be performed on inputs with the same number of columns, but the first input has <firstNumColumns> columns and the <invalidOrdinalNum> input has <invalidNumColumns> columns.

Number of given aliases does not match number of output columns. Function name: <funcName>; number of aliases: <aliasesNum>; number of output columns: <outColsNum>.

Non-deterministic expression <sqlExpr> should not appear in the arguments of an aggregate function.

Cannot cast <sourceType> to <targetType>.

Cannot convert Protobuf <protobufColumn> to SQL <sqlColumn> because schema is incompatible (protobufType = <protobufType>, sqlType = <sqlType>).

Unable to convert <protobufType> of Protobuf to SQL type <toType>.

Cannot convert SQL <sqlColumn> to Protobuf <protobufColumn> because schema is incompatible (protobufType = <protobufType>, sqlType = <sqlType>).

Cannot convert SQL <sqlColumn> to Protobuf <protobufColumn> because <data> is not in defined values for enum: <enumString>.

Cannot up cast <expression> from <sourceType> to <targetType>. <details>

Failed to decode a row to a value of the expressions: <expressions>.

Failed to encode a value of the expressions: <expressions> to a row.

Failed to cast value <value> to data type <dataType> for partition column <columnName>. Ensure the value matches the expected data type for this partition column.

Unable to create a Parquet converter for the data type <dataType> whose Parquet type is <parquetType>.

Illegal Parquet type: <parquetType>.

Unrecognized Parquet type: <field>.

Parquet type not yet supported: <parquetType>.

The class <className> has an unexpected expression serializer. Expects "STRUCT" or "IF" which returns "STRUCT" but found <expr>.

The routine <routineName> cannot be found. Verify the spelling and correctness of the schema and catalog. If you did not qualify the name with a schema and catalog, verify the current_schema() output, or qualify the name with the correct schema and catalog. To tolerate the error on drop use DROP ... IF EXISTS.

Could not resolve <name> to a table-valued function. Please make sure that <name> is defined as a table-valued function and that all required parameters are provided correctly. If <name> is not defined, please create the table-valued function before using it. For more information about defining table-valued functions, please refer to the Apache Spark documentation.

Cannot resolve routine <routineName> on search path <searchPath>.

Cannot resolve variable <variableName> on search path <searchPath>.

The variable <variableName> cannot be found. Verify the spelling and correctness of the schema and catalog. If you did not qualify the name with a schema and catalog, verify the current_schema() output, or qualify the name with the correct schema and catalog. To tolerate the error on drop use DROP VARIABLE IF EXISTS.

All unpivot value columns must have the same size as there are value column names (<names>).

CREATE TEMPORARY VIEW or the corresponding Dataset APIs only accept single-part view names, but got: <actualName>.

ALTER TABLE (ALTER|CHANGE) COLUMN cannot change collation of type/subtypes of bucket columns, but found the bucket column <columnName> in the table <tableName>.

ALTER TABLE (ALTER|CHANGE) COLUMN is not supported for partition columns, but found the partition column <columnName> in the table <tableName>.

Cannot ADD or RENAME TO partition(s) <partitionList> in table <tableName> because they already exist. Choose a different name, drop the existing partition, or add the IF NOT EXISTS clause to tolerate a pre-existing partition.

The partition(s) <partitionList> cannot be found in table <tableName>. Verify the partition specification and table name. To tolerate the error on drop use ALTER TABLE … DROP IF EXISTS PARTITION.

EXCEPT column <columnName> was resolved and expected to be StructType, but found type <dataType>.

DataType <dataType> is not supported for IDENTITY columns.

Can't overwrite the target that is also being read from.

Aggregate functions are not allowed in GROUP BY, but found <sqlExpr>.

GROUP BY <index> refers to an expression <aggExpr> that contains an aggregate function. Aggregate functions are not allowed in GROUP BY.

The FILTER expression <filterExpr> in an aggregate function is invalid.

The WHERE condition <condition> contains invalid expressions: <expressionList>. Rewrite the query to avoid window functions, aggregate functions, and generator functions in the WHERE clause.

Cannot specify both CLUSTER BY and CLUSTERED BY INTO BUCKETS.

Cannot specify both CLUSTER BY and PARTITIONED BY.

Cannot recognize hive type string: <fieldType>, column: <fieldName>. The specified data type for the field cannot be recognized by Spark SQL. Please check the data type of the specified field and ensure that it is a valid Spark SQL data type. Refer to the Spark SQL documentation for a list of valid data types and their format. If the data type is correct, please ensure that you are using a supported version of Spark SQL.

DataType <type> requires a length parameter, for example <type>(10). Please specify the length.

Incomplete complex type:

Failed to find the data source: <provider>. Make sure the provider name is correct and the package is properly registered and compatible with your Spark version.

Unable to find batch <batchMetadataFile>.

Could not load Protobuf class with name <protobufClassName>. <explanation>.

The schema of the data source table does not match the expected schema. If you are using the DataFrameReader.schema API or creating a table, avoid specifying the schema. Data Source schema: <dsSchema> Expected schema: <expectedSchema>

LOAD DATA input path does not exist: <path>.

Path does not exist: <path>.

Failed to rename as <sourcePath> was not found.

Failed to read the operator metadata for checkpointLocation=<checkpointLocation> and batchId=<batchId>. Either the file does not exist, or the file is corrupted. Rerun the streaming query to construct the operator metadata, and report to the corresponding communities or vendors if the error persists.

Failed to read the state schema. Either the file does not exist, or the file is corrupted. options: <sourceOptions>. Rerun the streaming query to construct the state schema, and report to the corresponding communities or vendors if the error persists.

Streaming stateful operator name does not match with the operator in state metadata. This likely to happen when user adds/removes/changes stateful operator of existing streaming query. Stateful operators in the metadata: [<OpsInMetadataSeq>]; Stateful operators in current batch: [<OpsInCurBatchSeq>].

Failed to rename <sourcePath> to <targetPath> as destination already exists.

Path <outputPath> already exists. Set mode as "overwrite" to overwrite the existing path.

The location name cannot be empty string, but <location> was given.

<sessionCatalog> requires a single-part namespace, but got <namespace>.

SHOW COLUMNS with conflicting namespaces: <namespaceA> != <namespaceB>.

Invalid options:

Cannot change <configName> from <oldConfig> to <newConfig> between restarts. Please set <configName> to <oldConfig>, or restart with a new checkpoint directory.

The given State Store Provider <inputClass> does not extend org.apache.spark.sql.execution.streaming.state.StateStoreProvider.

Cannot change <stateVarName> to <newType> between query restarts. Please set <stateVarName> to <oldType>, or restart with a new checkpoint directory.

The given State Store Provider <inputClass> does not extend org.apache.spark.sql.execution.streaming.state.SupportsFineGrainedReplay. Therefore, it does not support option snapshotStartBatchId or readChangeFeed in state data source.

The input schema <inputSchema> is not a valid schema string.