Transformation

Feature Type

Feature/node

Description / Subfeature

Azure
Databricks

AWS
Databricks

GCP
Databricks

GCP
Dataproc

AWS EMR

Snowflake

BigQuery

Target Types

Append Targets

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Merge Targets

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Overwrite Targets

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Update Targets

No

No

No

No

No

Yes

Yes

Delete Targets

No

No

No

No

No

Yes

Yes

SCD2 Support

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Source Read

Incremental Source read

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Delete Support

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Transformations

Filter

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Derive

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Join

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Aggregate

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Distinct

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Union

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Split

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Cleanse

Yes

Yes

Yes

Yes

Yes

Yes

Yes

In NotIn

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Fuzzy Match

Yes

Yes

Yes

Yes

Yes

No

No

Exists

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Lookup

Yes

Yes

Yes

Yes

Yes

No

No

Python Custom Transformation

Python 3

Yes

Yes

Yes

Yes

Yes

No

No

Java Custom Transformation

Java 8

Yes

Yes

Yes

Yes

Yes

No

No

Advanced Analytics Nodes

SparkML

Logistic Regression

Yes

Yes

Yes

Yes

Yes

No

No

Decision Tree

Yes

Yes

Yes

Yes

Yes

No

No

K-Means Clustering

Yes

Yes

Yes

Yes

Yes

No

No

Random-Forest Classification

Yes

Yes

Yes

Yes

Yes

No

No

H2O

Logistic Regression

Yes

Yes

Yes

Yes

Yes

No

No

Decision Tree

Yes

Yes

Yes

Yes

Yes

No

No

K-Means Clustering

Yes

Yes

Yes

Yes

Yes

No

No

Random-Forest Classification

Yes

Yes

Yes

Yes

Yes

No

No

Target Nodes

Hive Target (Parquet) (CSV, JSON, ORC, AVRO need to be validated)

No

No

Yes

Yes

No

No

No

Snowflake

Snowflake 2.11 using spark-snowflake_2.11-2.4.0.jar

Yes

Yes

Yes

Yes

Yes

Yes

Yes

DeltaLake

Runtime 5.5 using Databricks runtime client library

Yes

Yes

Yes

No

Yes

No

No

Azure Cosmos DB (Spark 2.x and Scala 2.12 is NOT supported)

Databricks runtime client library

Yes

Yes

Yes

Yes

Yes

No

No

AWS Redshift

Databricks runtime client library

Yes

Yes

Yes

Yes

Yes

No

No

Azure Synapse (SQL DW)

Azure SQL DW 10.0 using Databricks runtime client library

Yes

Yes

Yes

Yes

Yes

No

No

BigQuery

Yes

Yes

Yes

Yes

Yes

No

No

Teradata

16.2

Yes

Yes

Yes

Yes

Yes

No

No

Oracle

19c LTS

Yes

Yes

Yes

Yes

Yes

No

No

PostgreSQL / GCP Cloud SQL
(only PostgreSQL)

12 (12.5)

Yes

Yes

Yes

Yes

Yes

No

No

SQL Server

12.00.2000 & SQL Azure (RTM) 12.0.2000.8

Yes

Yes

Yes

Yes

Yes

No

No

Delimited Files

CSV

Yes

Yes

Yes

Yes

Yes

No

No

Python Custom Target

Python 3

Yes

Yes

Yes

Yes

Yes

No

No

Java Custom Target

Java 8

Yes

Yes

Yes

Yes

Yes

No

No

Derivations

Derivations

Yes

Yes

Yes

Yes

Yes

Storage Format

ORC Storage Format

Yes

Yes

Yes

Yes

Yes

No

No

Delta

Yes

Yes

Yes

No

Yes

No

No

AVRO

Yes

Yes

Yes

Yes

Yes

No

No

JSON

Yes

Yes

Yes

Yes

Yes

No

No

CSV

Yes

Yes

Yes

Yes

Yes

No

No

Parquet Storage Format

Yes

Yes

Yes

Yes

Yes

No

No

UniForm

Yes

Yes

No

No

No

No

No

Other Features

Partitioning

Yes

Yes

Yes

Yes

Yes

No

No

Optimization with Zorder

Yes

Yes

Yes

No

Yes

No

No

Sample Data

Yes

Yes

Yes

Yes

Yes

No

No

Indexing

No

No

Yes

No

No

No

No

Sort By

Yes

Yes

Yes

Yes

Yes

No

No

Bucketing

No

No

Yes

No

No

No

No

Delete Support

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Node SQL Preview

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Target SQL Preview

No

No

No

No

No

Yes

Yes

SQL Import

Yes

Yes

Yes

Yes

Yes

Yes

Yes

Java Support

Java 8 Support

Yes

Yes

Yes

Yes

Yes

Yes

Yes