Release 462-e LTS (27 November 2024)#

Dell Data Analytics Engine, powered by Starburst Enterprise platform (SEP) 462-e LTS is the follow up release to the 453-e LTS release.

It contains all improvements from Starburst Enterprise releases since the 453-e LTS release:

It includes all improvements from the following Trino releases:

Highlights since 453-e#

Breaking changes#

  • Legacy file system support for all catalogs has been disabled by default. You must activate the desired file system support with fs.native-azure.enabled,fs.native-gcs.enabled, fs.native-s3.enabled, or fs.hadoop.enabled in each catalog. Use the migration guides for Azure Storage, Google Cloud Storage, and S3 to assist if you have not switched from legacy support.

  • Starburst Helm charts are no longer accessible through the ChartMuseum API. Instead, use the OCI API.

  • Secrets configuration provider setup has been updated to use secrets.toml files. The configuration-provider.config-files property is no longer supported. You must update your configuration to use secrets.toml files.

  • The query.low-memory-killer.delay configuration property has been removed. You must remove this property or the cluster fails to start.

  • The CFT property S3PinToCurrentRegion is no longer supported.

  • The following connectors have been removed:

    • Local file

    • Atop

    • Raptor

  • The snowflake.database configuration property is now required if snowflake.database-prefix-for-schema.enabled is set to false, which is the default value. You must update existing Snowflake catalog configurations or the cluster fails to start.

  • The Custom Resource Definitions (CRDs) for the External Secrets Operator included in the SEP Helm Chart have been updated from v1beta1 to v1. Upgrade your External Secrets Operator to v0.17, which fully supports v1.

462-e initial changes#

General#

  • The Starburst Enterprise .rpm and .tar artifacts are now bundled with the Eclipse Temurin OpenJDK distribution from Adoptium, removing the requirement for a separate installation of Java for SEP.

  • Released Query result caching in general availability.

  • Added support for configuring a background job to delete expired result cache entries.

  • Updated Schema discovery UI to show table format information prior to scanning.

  • Fixed an issue that caused publishing data products to fail due to long SQL statements.

  • Fixed an issue with changing resource group templates in Workload management.

Hive connector#

Oracle connector#

Teradata connector#

  • Added support for CAST pushdowns of temporal types.

462-e.1 changes (27 Nov 2024)#

  • Added support for projection pushdown of upper, lower, trim, and substring functions in the Teradata connectors.

  • Improved performance when using various string functions in queries involving joins.

  • Updated Iceberg connector migration procedure to use nullable columns by default.

  • Fixed issue that printed unprocessed user input in server error responses.

  • Fixed missing security checks on SQL statements for schema discovery.

  • Fixed insert of invalid time zone data for tables using the TIMESTAMP WITH TIME ZONE type

  • Fixed incorrect results for queries filtering on partition columns when the NAME column mapping mode is used.

  • Fixed Hive query failures using Hive impersonation with delegated authentication.

462-e.2 changes (13 Dec 2024)#

  • Updated query result caching to use session property managers to resolve session property defaults and ensure that they are consistently applied.

  • Removed deprecated RubiX cache from SEP Helm chart.

  • Fixed query failures on impersonated Hive during delegated authentication checks.

  • Fixed incorrect column length of VARCHAR type in SingleStore version 8.

  • Fixed incorrect results when reading array columns and bigquery.arrow-serialization.enabled is set to true.

  • Fixed failure of S3 file listing of buckets that enforce requester pays.

  • Fixed incorrect quoting of output values when the CSV_UNQUOTED or CSV_HEADER_UNQUOTED format is used.

462-e.3 changes (15 Jan 2025)#

  • Starburst Helm charts are no longer accessible through the ChartMuseum API. Instead, use the OCI API.

  • Updated OpenSSL and libcurl native dependencies in Teradata Direct table operator.

  • Restored missing Kerberos support to Cassandra connector.

  • Fixed issue with hanging queries in Teradata Direct connector.

  • Fixed a bug that caused incorrect results for queries containing partition predicates with checkpoints that use NAME column mapping.

  • Fixed query failures or missing statistics in SHOW STATS when a connector returns NaN values for table statistics.

  • Fixed failure when writing concurrently with transformed partition columns.

  • Fixed an issue where Unity metastore returned an exception when attempting to list tables for a non-existent schema.

  • Prevented some query failures when retry-policy is set to task.

  • Fixed a bug that caused querying issues in the query editor when results cache is enabled.

  • Fixed correctness issue when writing deletion vectors in Delta Lake.

  • Fixed correctness issue when reading deletion vectors in Delta Lake.

  • Fixed failures when redirecting from incomplete or invalid Delta Lake tables.

462-e.4 changes (5 Feb 2025)#

  • Fixed a bug when reading from Spark-managed Iceberg tables with nested columns.

  • Fixed an issue that caused button height to fluctuate in dialogs during actions in progress.

462-e.5 changes (19 Feb 2025)#

  • Fixed serialization error when getting results containing ROW type for the query results cache.

  • Fixed parsing of negative hexadecimal, octal, and binary numeric literals.

  • Fixed failures with recursive delete operations on S3Express preventing usage of fault-tolerant execution.

  • Fixed failures when using the spooling protocol with a cluster using its own certificate chain.

  • Fixed failure when updating values to NULL.

  • Fixed catalog information in JMX metrics when using file system caching with multiple catalogs.

  • Fixed table read failures when using the Alluxio file system.

  • Prevented connection leakage when using the Azure Storage file system.

462-e.6 changes (28 Feb 2025)#

  • Fixed failure when executing CREATE OR REPLACE MATERIALIZED VIEW.

  • Fixed failure when using upper case variable names in SQL user-defined functions.

  • Fixed failures of the array_histogram() function when the input contains null values.

  • Fixed potential table corruption when using the vacuum procedure in Delta Lake.

  • Fixed NullPointerException when listing tables on Glue.

462-e.7 changes (18 Mar 2025)#

  • Fixed column masks not applying to columns in views with non-lowercase names.

  • Fixed failures caused by tables with case-sensitive name conflicts.

  • Prevented failures when fault-tolerant execution is configured with an exchange manager that uses Azure storage with workload identity.

462-e.8 changes (3 Apr 2025)#

  • Added support for limiting the max parallelism with the bigquery.max-parallelism configuration property in the BigQuery connector.

  • Fixed an issue which prevented temporal types in JOIN predicates being pushed down in the Netezza connector.

  • Fixed an issue in SCIM when updating group membership with Azure AD.

  • Fixed an issue with query preparation when result set caching is enabled.

  • Fixed failure for queries with large numbers of expressions in the SELECT clause.

462-e.9 changes (15 Apr 2025)#

  • Updated Parquet libraries to address CVE-2025-30065, though Starburst was not impacted because SEP uses a custom Parquet reader.

  • Fixed an issue that caused query failure when attempting to create a materialized view that referenced a catalog with impersonation enabled.

  • Fixed an issue that caused queries to hang when reading large tables.

  • Fixed failure when setting comments on columns with upper case letters.

462-e.10 changes (30 Apr 2025)#

  • Removed the Phoenix connector due to incompatibility with Java 24.

  • Improved performance for queries with large amounts of intermediate data.

  • Fixed Glue endpoint URL override.

462-e.11 changes (19 May 2025)#

  • Updated ignite-core dependency to 2.17.0 to mitigate CVE-2024-52577.

  • Updated Go to 1.23.8 to mitigate the multiple CVEs.

  • Fixed query failures with EXCEEDED_LOCAL_MEMORY_LIMIT errors due to incorrect memory accounting.

  • Fixed potential failures or incorrect results when querying partitioned tables using the OpenX JSON SerDe.

  • Fixed incorrect results when reading timestamp values with leading or trailing spaces using the Regex and OpenX JSON table deserializers.

  • Fixed potential performance regression when reading ORC data.

  • Fixed incorrect memory usage accounting for truncated tables.

462-e.12 changes (2 Jun 2025)#

  • Updated to include support for Java 24.

  • Fixed an issue which caused incremental refresh of materialized views to fail when using session credentials.