I have a recipe with the following

schema_pattern

(note the trailing

$

) working in 0.8.27 but not working in >= 0.8.28.

schema_pattern:
      allow:
      - ^my_database\$

This config is loaded as follows in 0.8.27 and tables in

my_database

being processed

[2022-03-21 12:11:33,341] DEBUG    {datahub.cli.ingest_cli:76} - Using config: {'source': {'type': 'hive', ..., 'schema_pattern': {'allow': ['^my_database$',

whereas in 0.8.28 gets loaded as follows

[2022-03-21 12:10:51,588] DEBUG    {datahub.cli.ingest_cli:76} - Using config: {'source': {'type': 'hive', ..., 'schema_pattern': {'allow': ['^my_database\\$',

This results on the database not matching the pattern in 0.8.28 and so being filtered out. So a recipe that was loading many tables with 0.8.27 loads none with 0.8.28. Was this a voluntary change fixing some bad previous behaviour? Or just a sort of bug that was introduced from 0.8.28 version?

Hey Sergio- this was a voluntary fix we announced here: https://datahubspace.slack.com/archives/CUMV92XRQ/p1646422718745969

I guess I can still use

$

in the reg exp patterns… so, how to escape then? or no need to escape at all?

there should be no need to escape at all

Great! Thanks a lot!