This message was deleted.

Hi Kalyanee, I use CTEs extensively, I think it just depends on the specific query. If you are encountering subquery row limit issues, then you can potentially use MSQ to run the queries with the sortMerge join method, which does not use broadcast joins and will avoid that problem. Otherwise if you are just having a general performance or logic issue getting the query to do what you want, feel free to post it so we can take a look. Thanks. John

Thanks for your response John. Based on the docs sortMerge join is only allowed for sql ingestion. Can you share more about the method you have suggested above?

Hi Kalyanee, CTE (Common Table Expression) is the "with" clause ... you can use it to break down our query logic into groups. SQL makes it pretty easy with this syntax, then it's a matter of piecing together the logical data manipulations you want to do. If you can post an example of what you are trying to do then members of the forum should be able to provide suggestions for phrasing it in an optimal manner. Thanks. John