OceanBase Database allows you to insert data into a database using direct load. This means OceanBase Database can directly write data into data files. Direct load bypasses the SQL layer interfaces, directly allocating space and inserting data into data files, thereby enhancing the efficiency of data import.
Scenarios
The direct load feature is suitable for the following scenarios:
Data migration and synchronization. When migrating and synchronizing a large amount of data of various formats from different data sources to OceanBase Database, the performance of traditional SQL interfaces may not meet the requirements for timeliness.
Traditional ETL. After data is extracted and transformed at the source, a large amount of data needs to be loaded to the destination within a short time. Using direct load technology can improve data import performance. During the ETL process, direct load technology can also enhance efficiency.
Loading data from text files or other data sources to OceanBase Database. Direct load technology can also improve the efficiency of loading data in this scenario.
Supported statements
OceanBase Database supports the following statements for direct load:
Considerations
Direct load writes all existing data. If the original table contains a large amount of data, but only a small amount of data is to be imported, direct load may not be suitable.