Skip to content

3.2.1

Compare
Choose a tag to compare
@bearmmx bearmmx released this 26 Dec 09:02
· 6128 commits to main since this release
79ee91d

Release date: December 21, 2023

New Features

Data Lake Analytics

  • Supports reading Hive Catalog tables and file external tables in Avro, SequenceFile, and RCFile formats through Java Native Interface (JNI).

Materialized View

  • Added a view object_dependencies to the database sys. It contains the lineage information of asynchronous materialized views. #35060
  • Supports creating synchronous materialized views with the WHERE clause.
  • Supports partition-level incremental refresh for asynchronous materialized views created upon Iceberg catalogs.
  • [Preview] Supports creating asynchronous materialized views based on tables in a Paimon catalog with partition-level refresh.

Query and SQL functions

Monitoring and alerts

  • Added a new metric max_tablet_rowset_num for setting the maximum allowed number of rowsets. This metric helps detect possible compaction issues and thus reduces the occurrences of the error "too many versions". #36539

Parameter changes

  • A new BE configuration item enable_stream_load_verbose_log is added. The default value is false. With this parameter set to true, StarRocks can record the HTTP requests and responses for Stream Load jobs, making troubleshooting easier. #36113

Improvements

  • Upgraded the default GC algorithm in JDK8 to G1. #37268
  • A new value option GROUP_CONCAT_LEGACY is added to the session variable sql_mode to provide compatibility with the implementation logic of the group_concat function in versions earlier than v2.5. #36150
  • The authentication information aws.s3.access_key and aws.s3.access_secret for AWS S3 in Broker Load jobs are hidden in audit logs. #36571
  • The be_tablets view in the information_schema database provides a new field INDEX_DISK, which records the disk usage (measured in bytes) of persistent indexes. #35615
  • The result returned by the SHOW ROUTINE LOAD statement provides a new field OtherMsg, which shows information about the last failed task. #35806

Bug Fixes

Fixed the following issues:

  • The BEs crash if users create persistent indexes in the event of data corruption.#30841
  • The array_distinct function occasionally causes the BEs to crash. #36377
  • After the DISTINCT window operator pushdown feature is enabled, errors are reported if SELECT DISTINCT operations are performed on the complex expressions of the columns computed by window functions. #36357
  • Some S3-compatible object storage returns duplicate files, causing the BEs to crash. #36103