Hi, I am new to datahub and exploring it. Is there already a Java API or at least the classes needed for MetadataChangeEvents in a maven artifact that I can use to publish new events to the api myself?

Hi @brave-furniture-58468 welcome! Your request is very timely as we're looking into publishing the Java artifacts currently.

Cool, I am thinking about writing a library interacting with kafka streams to track topics, schemas and lineage. Are there other people who are thinking about that?

@gray-shoe-75895 and @square-greece-86505 have been collaborating on Kafka Connect integration.

👋 Hey yeah, we are still discussing this approach vs publishing events from manifests changes (we use Strimzi to operate Kafka (User/Topic/ACL)) so these state change events are easy to capture on Kubernetes 🤔

Hey @billions-doctor-79207 yes this is definitely something we thought about as well, easy and simple to emit the lineage as declared by the configuration (versus from inside the task).

how you infer the lineage from state change events? or do you like to define them by hand? we are also using strimzi 😉

Hi + 1 for a Java based ingestion pipeline

Ack on this request 🙂 Will share something soon.

bid on it 😉