How can I use the function of modeling schemaMetadata and profiling for s3 objects without ingesting it into datahub (without doing 'datahub ingest -c'). I found the ability to extract schemaMetadata and profile on each column very helpful, but want to manage them myself.

You can find implementation here but these functions are not designed to be called independently of source.

I think that these are just powerful tools and can be applied to more cases than datahub itself..😂 Hope that these can be made individual some days.

Feel free to create a feature request for the same. so this will be on radar