ERROR thriftserver SparkExecuteStatementOperation Error executing query currentState RUNNING org apache spark sql catalyst errors package TreeNodeException

Question

Hi Guys,

When running complex SQL queries concurrently on Spark on terabytes of input data, I got this below error.

ERROR thriftserver.SparkExecuteStatementOperation: Error executing query, currentState RUNNING,
org.apache.spark.sql.catalyst.errors.package$TreeNodeException:

How to avoid this error?

Answer 1

Hi@akhtar,

You may resolve this exception, by increasing the value of spark.sql.broadcastTimeout parameter that controlled the internal timeout value. You can set this parameter in spark-defaults.conf file. 

spark.sql.broadcastTimeout 1200

Hope this will help.