OceanBase Database allows you to insert data into a database by using bypass import. In other words, OceanBase Database can directly write data into data files. With the bypass import feature, you can bypass interfaces in the SQL layer and directly allocate space and insert data into data files, thereby improving the data import efficiency.
Scenarios
The bypass import feature applies to the following scenarios:
Data migration and synchronization: For large-scale data migration and synchronization, bypass import can be more efficient compared with the traditional SQL interface, especially when importing data of various formats from different data sources into OceanBase Database.
Traditional ETL: Bypass import can improve data loading performance when a large amount of data needs to be loaded in a short period, such as in traditional ETL (extract, transform, load) processes. It can also enhance efficiency in ELT (extract, load, transform) processes during data loading.
Data loading from text files or other data sources to OceanBase database: Bypass import can accelerate the data loading process from various data sources.
Supported statements for bypass import
At present, OceanBase Database supports the following statements for bypass import:
LOAD /*+ APPEND */ DATAINSERT /*+ APPEND */ INTO SELECT
Considerations
Bypass import will write all existing data. If the source table contains a large amount of data but only a small amount of data needs to be imported, bypass import is inappropriate in this case.