FILE FORMAT

Config path: /<database>/<schema>/file_format/<name>.yaml

Example:

type: CSV
format_options:
  compression: GZIP
  record_delimiter: "\n"
  field_delimiter: ","
  skip_header: 1
  trim_space: true

Schema

• type (str) - file format type (CSV, AVRO, PARQUET, etc.)

• format_options (dict)

  • {key} (ident) - format option name

  • {value} (bool, float, int, list, str) - format option value

• comment (str)

Usage notes

1. Data type of {value} is important! Correct data type for each parameter can be obtained from output of DESC FILE FORMAT once you have at least one file format object. Alternatively, data type is available in CREATE FILE FORMAT documentation.

2. NULL_IF format options should be passed as list of strings.

Links

• CREATE FILE FORMAT
• SHOW FILE FORMATS
• DESC FILE FORMAT
• Parser & JSON Schema (GitHub)