Comment on page

FILE FORMAT

Config path: /<database>/<schema>/file_format/<name>.yaml
Example:
type: CSV
format_options:
  compression: GZIP
  record_delimiter: "\n"
  field_delimiter: ","
  skip_header: 1
  trim_space: true
Schema
type (str) - file format type (CSV, AVRO, PARQUET, etc.)
format_options (dict)
{key} (ident) - format option name
{value} (bool, float, int, list, str) - format option value
comment (str)
Usage notes
1.Data type of {value} is important! Correct data type for each parameter can be obtained from output of DESC FILE FORMAT once you have at least one file format object. Alternatively, data type is available in CREATE FILE FORMAT documentation.
2.NULL_IF format options should be passed as list of strings.
Links
​CREATE FILE FORMAT​
​SHOW FILE FORMATS​
​DESC FILE FORMAT​
​Parser & JSON Schema (GitHub)​

EXTERNAL TABLE

FUNCTION

Last modified 1yr ago