A handy tool that you can use to validate the JSON definition of your Avro schema.→ Continue reading “Online Avro Schema Validator”
Category: Avro
Using bq load Command to Load logicalType Partitioned Data into a BigQuery Table
Following is the syntax and bq load command that you need to issue if you want to load data in avro file into a partitioned BigQuery table based on avro field defined as a logicalType.
Given the following schema
{
"type" : "record",
"name" : "logicalType",
"namespace" : "com.ryanchapin.tests",
"fields" : [ {
"name" : "id",
"type" : [ "null", "string" ],
"default" : null
}, {
"name" : "value",
"type" : [ "null", "long" ],
"default" : null
},
→ Continue reading “Using bq load Command to Load logicalType Partitioned Data into a BigQuery Table”