OBLOADER & OBDUMPER V4.3.4

OBLOADER & OBDUMPER V4.3.4 released in July aims to support logical migration scenarios, adapt to new data types in OBServer V4.3.x, improve ORC import performance to meet business needs, and fix several known issues.

New features

• Logical migration: Added support for importing and exporting user and permission objects, as well as authorization statements, to meet the needs of logical migration scenarios.

• Performance improvement: Changed the read method for ORC files to parallel shard read/write, improving performance by more than 10 times.

• IPv6 support: Modified to support IPv6 addresses for data import and export.

• Adaptation for OBServer V4.3.x: Verified all queries for compatibility and added support for new data types in MySQL compatible mode, including roaringbitmap, vector, sparsevector, array, and map.

• Adaptation for ClickHouse: Added support for importing CSV files generated by ClickHouse, resolving compatibility issues with boolean value fields.

• Experience improvements

  • Added memory water level control during import to reduce memory overflow probability.

  • Added garbage collection (GC) information printing during import to help identify performance bottlenecks.

  • Added file position printing information in CSV import error messages to help locate the erroneous character position.

• New startup parameters

  • enable.partition.calculation: Controls whether to enable partition calculation during import. Enabled by default.

  • enable.definer: Controls whether to include definer information when exporting stored procedure and function definitions. Enabled by default.

  • enable.table.index: Controls whether to include index information when exporting table definitions in Oracle compatible mode. Enabled by default.

  • enable.table.comment: Controls whether to include table comments when exporting table definitions in Oracle compatible mode. Enabled by default.

  • enable.table.column.comment: Controls whether to include column comments when exporting table definitions in Oracle compatible mode. Enabled by default.

Compatibility changes

• If --table='*' --ddl does not match any objects, the behavior has changed from returning an error to exiting normally.

Bug fixes

• Fixed the issue where the --max-tps parameter is not accurately controlled during import.

• Fixed the issue where an error "The column type is null" is reported when using the exclude instruction to exclude the primary key or unique key during export.

• Fixed the issue where an error "may not perform insert/delete/update operation inside a READ ONLY transaction" is reported when exporting objects from a read-only instance in the Oracle compatible mode of OceanBase Database.

• Fixed the issue where, in the Oracle compatible mode of OceanBase Database, when using the MIX or SQL mode for import, OBLOADER may enter a dead loop and eventually cause a memory overflow due to the inability to correctly parse SQL content with backslashes.

• Fixed the issue where an ArrayOutOfBoundException error is reported during partition calculation caused by the expansion of the control file.

• Fixed the issue where bad and discard records have a small probability of not being recorded in the log file during import.

• Fixed the issue where, when no escape character is specified, the import may fail due to incorrect calculation of logical split positions during the import of CSV files.

• Fixed the issue where the component reports an error and exits when no objects need to be exported.

• Fixed the issue where a large number of "Calculate leader of table failed, treat it as non-partition table." errors are reported during import.

• Fixed the issue where, when exporting to OSS and OSS does not support multi-chunk encoding, OBLOADER incorrectly reports export success but no data is actually written to OSS.

• Fixed the issue where the --replace-object parameter is invalid for type objects.

• Fixed the issue where exporting a type object that ends with a semicolon and then importing it fails, and an error "Syntax Error" is reported.

• Fixed the issue where, in the Oracle compatible mode of OceanBase Database, the import and export of objects with lowercase usernames and lowercase schemas fail.

• Fixed the issue where, when not specifying the --table or --all option during import and export, a NullPointerException (NPE) error is reported.

• Fixed the issue where an empty exception is reported when the number of imported columns does not match.

• Fixed the issue where it is not possible to specify a file name to export data to an OSS file.

• Fixed the issue where an error "The next value is bigger than the max value" is reported when exporting sequences.

• Fixed the issue where, in the Oracle compatible mode of OceanBase Database, an error "No valid replicas" is reported when exporting temporary tables through snapshots.

• Fixed the issue where it is not possible to allocate more than 48 GB of memory to the data export component.

• Fixed the issue where, in --server mode, the data export component incorrectly displays a successful import, but the import fails.

• Fixed the issue where, during data export, the export load is concentrated on the same table or several partitions of the same table at the same time.

Vulnerability fixes

• Upgrade the obkv-table-client version to resolve the CVE-2025-24970 vulnerability associated with the netty-handler-4.1.100.Final component.

• Upgrade the Avro version to resolve the CVE-2024-47561 vulnerability associated with the avro-1.11.3 component.

Dependency library upgrades

• Upgrade the version of the oceanbase-client component from V2.4.11 to V2.4.14.

• Upgrade the version of the ob-sql-parser component from V1.4.0 to V1.4.2.

• Upgrade the version of the obkv-table-client component from V1.2.13.1 to V1.2.13.2.

• Upgrade the version of the Avro component from V1.11.3 to V1.11.4.