Anyone know if there's something akin to an

add_documentation

transformer out there? I was thinking of adding one that would populate the documentation tab with a template or something for urns gathered in a recipe

@lemon-hydrogen-83671: there isn't, might be useful! There is an example script that shows how to add documentation. https://github.com/linkedin/datahub/blob/master/metadata-ingestion/examples/library/dataset_add_documentation.py

Thanks, i noticed that a lot of the transformers have something that looks like this:

def transform(
        self, record_envelopes: Iterable[RecordEnvelope]
    ) -> Iterable[RecordEnvelope]:
        for envelope in record_envelopes:
            if isinstance(envelope.record, MetadataChangeEventClass):
                envelope.record = self.transform_one(envelope.record)
            yield envelope

A bit of a silly question but do transformers need to use the old MCE format? I see sources like kafka emit the MCE for its work-unit which makes me think i can't use MCPs for my custom transformer