Hi team, I'm wondering how to exclude specific pat...
# ingestion
m
Hi team, I'm wondering how to exclude specific path using regex pattern for source S3.
"**/*test*/**"
works, while
**/(^|_)(tmp|temp|test)(_|$)/**"
do not work. Anyone can help?
1
g
Hi @microscopic-room-90690 Please pathspec section on doc https://datahubproject.io/docs/generated/ingestion/sources/s3#path-specs for possible options
d
I think, we don’t yet support such regexp patterns
m
@dazzling-judge-80093 Thank you for reply. Is there any way to achieve the same function?
@gentle-hamburger-31302 Thank you, I referred this link while it seems it doesn't support complex pattern