Skip to content

File pulse connector unable to ingest Avro file with deeply nested schema and multiple complex objects are common in different nodes of the schema #712

Open
@hvinjarapu

Description

@hvinjarapu

Does File pulse connector create avro schema based on data being passed in the input avro file all time. I have registered schema to be used into my schema registry and made auto.register.schmas as false, expected the input avro file to be ingested successfully but getting error .The gist of error is that the file pulse is comparing the schema which i published to schema registry and its internally generated schema and is giving incompatible schema error. Also when i tried creating the schema pulse is creating by looking at the connector log in the schema registry, its giving invalid schema.so unable to ingest my avro file. Point to note is i am using a deeply nested schema and there are multiple objects that are common in different nodes of the schema. Can anyone please help analyse and find root cause of the issue

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions