Description
This statement creates a new external table in the database.
An external table is a key feature in a database management system. Generally, a table in a database stores data in the storage space of the database, while an external table stores data in an external storage service.
When you create an external table, you must specify the file path and file format of the data. After that, you can use the external table to read data from the external storage service. An external table is read-only. You can use it in a query statement, but you cannot perform DML operations on it. You cannot define constraints or create indexes on an external table.
Syntax
CREATE EXTERNAL TABLE <table_name>
( [ <column_name> <column_type> [AS <expr>] ]
[ , <column_name> <column_type> [AS <expr>] ]
[ , ... ] )
LOCATION = '<string>'
FORMAT = (
TYPE = 'CSV'
LINE_DELIMITER = '<string>' | <expr>
FIELD_DELIMITER = '<string>' | <expr>
ESCAPE = '<character>' | <expr>
FIELD_OPTIONALLY_ENCLOSED_BY = '<character>' | <expr>
ENCODING = 'charset'
NULL_IF = ('<string>' | <expr>, '<string>' | <expr> ...)
SKIP_HEADER = <int>
SKIP_BLANK_LINES = { TRUE | FALSE }
TRIM_SPACE = { TRUE | FALSE }
EMPTY_FIELD_AS_NULL = { TRUE | FALSE }
)
[ PATTERN = '<regex_pattern>' ]
Parameter description
Parameter |
Description |
|---|---|
| table_name | The name of the external table to be created. |
| column_name | The name of the external table column. By default, the data columns in the file are automatically mapped to the columns defined in the external table in order. |
| column_type | The data type of the external table column. You cannot define constraints such as DEFAULT, NOT NULL, UNIQUE, CHECK, PRIMARY KEY, or FOREIGN KEY. |
| AS |
Manually specifies column mappings. When the order of columns in a file is different from that defined in the external table, you can specify the correspondence between a column in the external table and the Nth column in the file by using the pseudo-column metadata$filecol{N}. For example, c2 INT AS (metadata$filecol4) indicates that the c2 column in the external table corresponds to the fourth column in the file. Note that if you specify manual column mappings, automatic mappings will become invalid, and you must specify mappings for all columns. |
| LOCATION | The path where the external table files are stored. Generally, the data files of an external table are stored in a single directory, which can contain subdirectories. When you create the table, the external table automatically collects all files in the directory.
NoticeWhen you use an object storage path, separate the parameters in the object storage path with |
| FORMAT | The format of external files.
|
| PATTERN | A regular expression string that is used to filter files in the directory specified by LOCATION. For each file in the directory specified by LOCATION, if the file path matches the pattern string, the external table accesses the file. Otherwise, the external table skips the file. If this parameter is not specified, the external table, by default, accesses all files in the directory specified by LOCATION. The external table stores the list of files that match the PATTERN string in the database system table. When the external table is scanned, it accesses external files based on this list. The file list can be automatically or manually updated. |
Usage
- If an external file is deleted, files in the file list of the external table will no longer exist. In this case, the external table ignores the non-existent files.
- If an external file is modified, the external table accesses the latest data of the external file. When the modification of an external file conflicts with a query on the external table, the result of the query may be unexpected. Therefore, avoid modifying external files while querying the external table.
- If a new file is added to an external directory, the external table does not access the new file. To add the new file to the file list of the external table, execute the ALTER EXTERNAL TABLE statement with the ADD FILE option.
Examples
Prepare data. First, set the path of
secure_file_privto/home/admin/. Place the CSV fileextdata.csv, which corresponds to the data of the external table to be imported, in the/home/admin/testdirectory of the local OBServer node that is connected.Here is an example of setting the global secure path.
obclient> SET GLOBAL secure_file_priv = "" Query OK, 0 rows affected obclinet> \q ByeNote
After you set the
secure_file_privvariable to a value, you must execute the\qstatement to make the setting take effect.The CSV file contains the following data:
1,'Dave','Smith','dsmith@outlook.com','friend',32 2,'Xena','Johnson','xjonson@outlook.com','contact',45 3,'Fred','Jackon','fjackson@outlook.com','co-worker',19 4,'Alma','Tyler','atyler@outlook.com','friend',53Log in to the database as a user in the tenant and create an external table named
contacts.obclient> CREATE EXTERNAL TABLE contacts ( id INT, firstname VARCHAR(100), lastname VARCHAR(100), email VARCHAR(255), category CHAR(30), age NUMBER ) LOCATION = '/home/admin/test/' FORMAT = ( TYPE = 'CSV' FIELD_DELIMITER = ',' FIELD_OPTIONALLY_ENCLOSED_BY ='''' )PATTERN ='extdata.csv';Query data in the
contactsexternal table.obclient> SELECT * FROM contacts; +------+-----------+----------+----------------------+--------------------------------+------+ | ID | FIRSTNAME | LASTNAME | EMAIL | CATEGORY | AGE | +------+-----------+----------+----------------------+--------------------------------+------+ | 1 | Dave | Smith | dsmith@outlook.com | friend | 32 | | 2 | Xena | Johnson | xjonson@outlook.com | contact | 45 | | 3 | Fred | Jackon | fjackson@outlook.com | co-worker | 19 | | 4 | Alma | Tyler | atyler@outlook.com | friend | 53 | +------+-----------+----------+----------------------+--------------------------------+------+ 4 rows in set
