OBLOADER & OBDUMPER V4.3.7

OBLOADER & OBDUMPER V4.3.7 enhances authentication, spatial data import, table remapping and object skipping during import, Oracle-mode DDL export, stability for large files and split processing, and native compatibility with Windows. It also fixes known issues and upgrades key dependencies to improve compatibility, stability, and usability across migration and import/export scenarios.

New features

• Added the --remap-table option to map a source table name to a different target table name during import. This option applies when table naming conventions differ across environments, such as test and production environments, or when the same data must be imported into different target tables. You do not need to manually modify the exported files or SQL scripts.

• Added the --skip-existing-object option to automatically skip objects that already exist in the target database during schema import. Skipped objects are displayed with the SKIPPED status in the summary. This option applies to incremental schema import and rerunning interrupted tasks. It prevents import failures caused by existing objects and clearly identifies the skipped objects.

• Added support for MySQL caching_sha2_password authentication. When caching_sha2_password is enabled for an OceanBase Database account, OBLOADER and OBDUMPER automatically complete the authentication handshake without requiring changes to the connection parameters.

• Added support for importing spatial geometry data in Well-Known Text (WKT) format from flat files such as Parquet files into MySQL POINT or GEOMETRY columns. The longitude-latitude axis order for SRID 4326 is handled correctly. This feature applies when spatial data for services such as maps and IoT applications is imported in batches from data lakes such as OSS and S3 into OceanBase Database, without requiring additional data format conversion.

• Added support for reading manifest files from input streams and ZIP or JAR URLs. This feature allows OBLOADER and OBDUMPER to identify version and configuration information in more runtime environments, including CI/CD pipelines and containerized deployments.

• Improved Windows compatibility by removing the dependency on Hadoop native components and fixing issues related to path handling, file naming, and checkpoint files. OBLOADER and OBDUMPER can now run on Windows without additional native dependencies and support file paths that contain spaces or special characters, as well as paths on different drives.

• Enhanced startup audit logs. The complete startup command and parsed parameters are masked and automatically written to log files. This feature helps trace execution configurations and troubleshoot issues when terminal output is unavailable, such as in batch scheduling and automated O&M scenarios.

Bug fixes

• Fixed an issue where Direct Load did not check the server-side failure status of beginFuture, and an issue where incompatible runtime dependencies could cause a task to hang. Logs for the byte ranges of failed data are also added.

• Fixed an issue where residual .mtmp temporary files were not deleted when a file merge task started.

• Fixed unclear error messages when an export file path was missing and an issue where filenames containing multiple periods were truncated.

• Fixed an S3 connection leak caused by failing to close the RecordReader before rolling an ORC stripe. The connection request timeout for object storage is also changed to 5 minutes.

• Fixed an issue where nested REPLACE functions in control files caused column values to be lost and newline characters to be incorrectly removed.

• Fixed data loss or memory growth when CUT files contained escaped line delimiters, split boundaries at empty lines or the end of a file, or cached trail delimiters.

• Fixed CSV parsing issues involving an empty --null-string, a final line without a line break, or a CRLF sequence that crossed a split boundary.

• Fixed an incorrect DATE format when data was exported by using --query-sql in Oracle mode.

• Fixed an issue where Oracle TYPE and TYPE BODY definitions could not be split correctly when they followed type modifiers.

• Fixed an issue in OceanBase Database Oracle mode where a NOT NULL constraint with the same name as an ordinary index caused the index to be incorrectly filtered out, and an issue where a function-based index with the same name was not retained.

• Fixed an issue where the FORCE and WITH READ ONLY clauses were omitted when views were exported from OceanBase Database in Oracle mode.

• Fixed issues in --mix mode where consecutive spaces in UPDATE and DELETE literals were collapsed, REPLACE statements and DML statements preceded by comments were processed incorrectly, and triggers containing version comments were split incorrectly.

• Fixed an issue where an import task was incorrectly terminated when the sampled committed JVM heap size was greater than the maximum heap size.

• Fixed an issue where the OBLD version marker was not retained as an SQL hint.

• Fixed an issue where system schemas were not filtered out during Oracle schema enumeration.

• Fixed an exception that occurred during export with --server when secure_file_priv was NULL.

• Fixed an issue where an incorrect source was selected for partition metadata when interval-partitioned tables were exported.

• Fixed issues in multi-schema tasks where tenant-level users and roles were exported repeatedly and --all routed objects incorrectly.

• Optimized Oracle DDL metadata queries to avoid repeatedly querying metadata for individual objects.

Security fixes

• Fixed a Kryo deserialization vulnerability by allowing only registered trusted types to be deserialized, reducing the risk of unsafe deserialization.

• Upgraded third-party dependencies with known security risks and removed the Commons Collections 3 runtime dependency.

Dependency upgrades

• Upgraded oceanbase-client from 2.4.17 to 2.4.18.

• Upgraded obkv-table-client from 1.2.13.2 to 2.4.0.

• Upgraded ob-partition-calculator from 1.8.0-RELEASE to 1.8.3-RELEASE.

• Upgraded Hadoop from 3.4.0 to 3.4.3.

• Upgraded AWS SDK from 2.23.19 to 2.35.4.

• Upgraded Jackson from 2.15.2 to 2.18.9.

• Upgraded Bouncy Castle from 1.78.1 to 1.85.

• Upgraded commons-io from 2.16.1 to 2.22.0.

• Upgraded commons-text from 1.10.0 to 1.15.0.

• Upgraded commons-lang3 from 3.18.0 to 3.20.0.

• Upgraded commons-compress from 1.26.2 to 1.28.0.

• Upgraded commons-configuration2 from 2.10.1 to 2.15.1.

• Upgraded commons-codec from 1.13 to 1.22.0.