If you try to deserialize a protobuf message without the corresponding schema you get a generic message error message:

[INFO] [record_query::proto_index] Proto descriptor cache is stale; recomputing
Missing input file.
thread 'main' panicked at 'protoc descriptor compilation failed', src/proto_index.rs:60
note: Run with `RUST_BACKTRACE=1` for a backtrace.

It would be nice to g

The title might seem a bit vague but I don't know how to describe it any better tbh :-)

Anyway this is what happened: I got some 500 responses from the schema registry and all I could see in the logs was :

[2020-04-02 16:03:35,048] INFO 100.96.14.58 - - [02/Apr/2020:16:03:34 +0000] "PUT /config/some-topic-value HTTP/1.1" 500 69  502 (io.confluent.rest-utils.requests)

The logs di

getting the following error message.

ksql> CREATE STREAM CUSTOMERS_SRC WITH (KAFKA_TOPIC='asgard.public.customers', VALUE_FORMAT='AVRO'); Avro schema for message values on topic asgard.public.customers does not exist in the

Currently, there isn't a way to get the table properties in the SparkOrcWriter via the WriterFactory.

Over time we've had some things leak into the diff methods that make it more cumbersome to use BigDiffy via code instead of CLI.

For example diffAvro here https://github.com/spotify/ratatool/blob/master/ratatool-diffy/src/main/scala/com/spotify/ratatool/diffy/BigDiffy.scala#L284

User has to manually pass in schema otherwise we they receive a non-informative error regarding null schema, add

The documentation says you can use S3 as a file sink but gives zero details on how to do so. There is one line linking somewhere else but the link is broken.
These are the docs: http://divolte-releases.s3-website-eu-west-1.amazonaws.com/divolte-collector/0.9.0/userdoc/html/configuration.html
and this is the broken link: https://wiki.apache.org/hadoop/AmazonS3

Having stdout output and configuration through command line options will allow to use Storagetapper as a command line utility.

Here's a .avdl file with a deliberate typo.

@namespace("integrationtest")
protocol WeatherService {

  record GetForecastRequest {
    // NOTE: missing semicolon
    string city
    int days_required;
  }

  enum Weather {
    SUNNY,
    CLOUDY,
    RAINY
  }

  record GetForecastResponse {
    string last_updated;
    array<Weather> daily_forecasts;
  }

  void ping(