Export to Snowflake is failing with Caused by net.snowflake.client.jdbc.SnowflakeSQLException Statement reached its stat

Export to Snowflake is failing with Caused by: net.snowflake.client.jdbc.SnowflakeSQLException: Statement reached its statement or warehouse timeout of X second(s) and was canceled

Problem Description:

Export to Snowflake fails with an error Failed during pipeline batch build : [TASK_EXECUTION_ERROR: 2524]

When we look at the actual YARN log for the YARN application that was submitted for the export job or the Databricks log for the export JOB we may see a below error

Caused by: net.snowflake.client.jdbc.SnowflakeSQLException: Statement reached its statement or warehouse timeout of 3,600 second(s) and was canceled.

Root Cause:

This is because the snowflake query is getting timed out after 3600 seconds

This happens because of parameter STATEMENT_TIMEOUT_IN_SECONDS set at the warehouse level with the xxx seconds.

If the warehouse level number is less for the parameter STATEMENT_TIMEOUT_IN_SECONDS, it takes precedence over the account, and therefore the query times out.

#

Solution:

You can identify the parameter details and it's value by running the below statements and make the changes to the parameter STATEMENT_TIMEOUT_IN_SECONDS to a high value to avoid this issue :

xxxxxxxxxx

show parameters like '%STATEMENT_TIMEOUT_IN_SECONDS%' for warehouse ;

show parameters like '%STATEMENT_TIMEOUT_IN_SECONDS%';

To make the changes, you can alter this parameter for your warehouse or account, whichever value is less:

xxxxxxxxxx

alter warehouse  set STATEMENT_TIMEOUT_IN_SECONDS=172800;