from_avro
function
Applies to: Databricks SQL Databricks Runtime 15.4 and later
Returns a struct value with the avroBin
and jsonSchemaStr
.
Arguments
avroBin
: ABINARY
expression specifying a row of Avro data.avroSchemaSpec
: The target schema in JSON format. It must match the schema encoded inavroBin
as specified in to_avro().options
: An optionalMAP<STRING,STRING>
literal specifying directives.
Returns
A STRUCT
with field names and types based on the result of schema_of_json(jsonStr).
avroBin
must be well-formed with respect to the avroSchemaSpec
and options
or Databricks raises an exception.
Notes
The following options are most common supported:
Option |
Value |
Description |
---|---|---|
|
|
In |
|
|
Specifies the compression codec used to encode the Avro data. |
For more options see Read and write streaming Avro data.
Examples
> SELECT from_avro(to_avro(5), '{ "type" : "int" }');
5
> SELECT from_avro(to_avro(5, '{ "type" : "int" }'), '{ "type" : "int" }');
5
> SELECT from_avro(to_avro(named_struct('num', 5, 'txt', 'hello')), '{ "type" : "record", "name": "my_record", "fields": [{ "name": "num", "type": "int"}, { "name": "txt", "type": "string"}]}');
{"num":5,"txt":"hello"}
> SELECT from_avro(to_avro(named_struct('num', 5, 'txt', 'hello')),
'{ "type" : "record", "name": "my_record", "fields": [{ "name": "num", "type": "int"}, { "name": "txt", "type": "double"}]}',
map('mode', 'failfast'));
Error: Avro data is not valid for the specified schema.
> SELECT from_avro(to_avro(named_struct('num', 5, 'txt', 'hello')),
'{ "type" : "record", "name": "my_record", "fields": [{ "name": "num", "type": "int"}, { "name": "txt", "type": "double"}]}',
map('mode', 'permissive'));
{"num":null,"txt":null}