A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi! How can I enable the `statefulIngestionCapable` mentioned <https://datahubproject.io/docs/metadata-ingestion/source_docs/stateful_ingestion/|here>?
I only found this reference in a java class <https://github.com/linkedin/datahub/search?q=statefulIngestionCapable|here>. Do I need to rebuild the project just to enable it?

Hi <@U027ZS25RFS>, you can either rebuild from the latest head or use any backend version &gt;= 0.8.20.

Do you mean that this is not a feature flag that can be enabled/disabled but a feature that is available from 0.8.20?

This confused me:
&gt; This is an explicit opt-in feature and is not enabled by default.

well, whatever :slightly_smiling_face: I just checked it out and it is enabled
```bash-5.1$ curl <http://localhost:8080/config>
{
  "models" : { },
  "versions" : {
    "linkedin/datahub" : {
      "version" : "v0.8.23+0.1.0",
      "commit" : "bcf7d0428a04be82d4ae28c82a4acbcbed70c801"
    }
  },
  "statefulIngestionCapable" : true,
  "retention" : "true",
  "noCode" : "true"
}
bash-5.1$ ```

So on the server side, it's a feature only enabled post 0.8.20. However, on the client (ingestion side) there's yet another toggle to enable or disable it in the configuration of recipe. This is what is meant by opt in :slightly_smiling_face:

Got it! Thanks for the clarification John