Release 453-e LTS (30 Aug 2024)#

Dell Data Analytics Engine, powered by Starburst Enterprise platform (SEP) 453-e LTS is the follow up release to the 443-e LTS release.

It contains all improvements from Starburst Enterprise releases since the 443-e LTS release:

It includes all improvements from the following Trino releases:

Highlights since 443-e#

Breaking Changes#

  • SEP now requires JDK 22 to run.

  • The following configuration properties and catalog configuration properties have been removed. These properties must be removed from all configurations or the cluster fails to start:

    • delta.max-initial-splits

    • delta.max-initial-split-size

    • legacy.materialized-view-grace-period

  • The PARTITION_COLUMN and PARTITION_VALUE arguments for the flush_metadata_cache procedure of the Hive connector have been renamed to PARTITION_COLUMNS and PARTITION_VALUES, respectively. The old argument names no longer work.

  • The BigQuery connector now enables Arrow serializaion by default, which requires a JVM configuration. You must either add --add-opens=java.base/java.nio=ALL-UNNAMED to your jvm.config or set the bigquery.arrow-serialization.enabled catalog configuration property to false in your BigQuery catalog configurations.

  • Phoenix versions 5.1.x and earlier are no longer supported by the Phoenix connector.

  • The Warp Speed REST API is no longer enabled by default. To enable the Warp Speed REST API, set warp-speed.config.extensions.enabled=true.

  • Warp Speed custom warmup rules are no longer stored in an external RDBMS. Warmup rules are now saved in object storage in a location specified in warp-speed.objectstore.store.path. In order to allow an existing warmup configuration to continue uninterrupted, you must export any existing rules from the external database and import them to object storage, then update your catalog configuration with the object store path.

  • The optimizer.mark-distinct-strategy and optimizer.optimize-mixed-distinct-aggregations configuration properties have been removed and are replaced by optimizer.distinct-aggregations-strategy.

  • The bigquery.parallelism configuration property has been removed as scan parallelism is now enabled by default on the BigQuery connector.

  • The hive.experimental.schema-discovery.enabled catalog configuration property has been removed as schema discovery is enabled by default. You must remove this property from the cluster configuration or SEP fails to start.

453-e initial changes#

General#

Security#

Delta Lake connector#

Hive connector#

Hudi connector#

Iceberg connector#

Netezza connector#

SAP HANA connector#

Snowflake connector#

  • Added support for enforcing DEFINER security authorization during query execution for views when using impersonation.

Teradata connector#

  • Added support for enforcing DEFINER security authorization during query execution for views when using impersonation.

  • Added support for execute procedure.

453-e.1 changes (30 August 2024)#

  • Fixed failure when a user-defined type name contains uppercase characters.

  • Fixed the Trino username incorrectly defaulting to the name of the user running the Trino process when no username is specified.

  • Fixed query failure when file-based network topology is configured with the node-scheduler.network-topology.file configuration property.

  • Fixed failure for queries involving json_parse() and a cast to array, map, or row.

  • Fixed an issue that affected managed statistics collection on wide Teradata tables in specific circumstances.

453-e.2 changes (13 Sep 2024)#

  • Fixed an issue which prevented sysadmin role from using Schema Discovery UX. To run schema discovery, the service account referenced by schema-discovery.starburst-user must be listed in starburst.access-control.authorized-users.

  • Fixed a bug that caused cluster metrics to be created with incorrect intervals and subsequently led to loss of cluster metrics data.

  • Fixed query failures when Parquet files contain column names that only differ in case.

  • Fixed memory tracking issue for aggregations that could cause worker crashes with out-of-memory errors.

  • Fixed UI regression caused by incorrect property name.

  • Fixed Run and troubleshoot feature when insights.authorized-groups configuration property contains authorized groups.

  • Fixed numeric overflow during managed statistics computation for large tables in Teradata mode session.

453-e.3 was skipped.

453-e.4 changes (18 Oct 2024)#

  • Enabled Warp Speed REST extensions by default.

  • Fixed failures with queries using table functions when parent-project-id is defined.

  • Fixed OpenX JSON decoding a JSON array line that resulted in data being written to the wrong output column.

  • Fixed reading large Prometheus responses.

  • Fixed query failure when bigquery.service-cache-ttl configuration property is not 0ms and case-insensitive-name-matching is enabled.

  • Fixed rare bug causing long planning times when Hive metastore caching is enabled.

  • Fixed failures for count(*) queries with predicates containing non-ASCII strings.

  • Fixed failure when bigquery.case-insensitive-name-matching is enabled and bigquery.case-insensitive-name-matching.cache.ttl is set to 0m.

453-e.5 changes (4 Nov 2024)#

  • Added support for tinyint or smallint to integer type coercion in Iceberg.

  • Use hive.metastore.partition-batch-size.max config property value in sync_partition_metadata procedure. The default batch size is changed to 100 from 1000.

  • Updated Iceberg connector migration procedure to use nullable columns by default.

  • Fixed query failure in MaxCompute connector when additional projects are specified with maxcompute.additional-projects.

453-e.6 changes (14 Nov 2024)#

  • Fixed memory leak in InMemoryEventClient within cache service.

  • Fixed incorrect results when reading array columns and bigquery.arrow-serialization.enabled is set to true.

453-e.7 changes (27 Nov 2024)#

  • Improved performance when using various string functions in queries involving joins.

  • Fixed insert of invalid time zone data for tables using the TIMESTAMP WITH TIME ZONE type.

  • Fixed incorrect results for queries filtering on a partition columns and the NAME column mapping is used.

  • Fixed server error responses printing unprocessed user input.

  • Fixed query failures on impersonated Hive during delegated authentication checks.