Wondering if anyone ever hit this limit with Eleme...
# community-supportn
Niteesh Kanungo
04/02/2025, 7:21 PMWondering if anyone ever hit this limit with Elementary tests. I am getting this error where we have a failing
on-end-run Copy code
Too many tables, views and user-defined functions for query: Max: 1000Niteesh Kanungo
04/03/2025, 2:30 PM@Noya Offer
I am using this config already
Copy code
# elementary limits
dbt_artifacts_chunk_size: 300
insert_rows_method: "chunk"
query_max_size: 100000
disable_dbt_columns_autoupload: true👀 1
n
Noya Offer
04/03/2025, 2:33 PMLooked into it and saw that you're a contributor for this 😅
Try adding this, should take a big load off the hooks. This has no effect on the CLI, it's related to Cloud features.
Copy code
vars:
columns_upload_strategy: nonen
Niteesh Kanungo
04/03/2025, 8:19 PMI removed some of the tests to under 1000 and now its working.
I am seeing another issue in the prod erroring
Copy code
ERROR 2025-04-03T19:54:30.807743125Z /usr/local/lib/python3.9/site-packages/bs4/__init__.py:332: MarkupResemblesLocatorWarning: "analysis" looks like a filename, not markup. You should probably open this file and pass the filehandle into Beautiful Soup.
ERROR 2025-04-03T19:54:30.807847Z warnings.warn(
ERROR 2025-04-03T19:54:31.160860059Z /usr/local/lib/python3.9/site-packages/bs4/__init__.py:417: MarkupResemblesLocatorWarning: "<https://doi.org/10.1111/tan.13811>" looks like a URL. Beautiful Soup is not an HTTP client. You should probably use an HTTP client like requests to get the document behind the URL, and feed that document to Beautiful Soup.
ERROR 2025-04-03T19:54:31.160967604Z warnings.warn(
ERROR 2025-04-03T19:54:31.935331992Z /usr/local/lib/python3.9/site-packages/bs4/__init__.py:417: MarkupResemblesLocatorWarning: "<http://www.ensembl.org>" looks like a URL. Beautiful Soup is not an HTTP client. You should probably use an HTTP client like requests to get the document behind the URL, and feed that document to Beautiful Soup.
ERROR 2025-04-03T19:54:31.935462075Z warnings.warn(
ERROR 2025-04-03T19:54:31.935623400Z /usr/local/lib/python3.9/site-packages/bs4/__init__.py:417: MarkupResemblesLocatorWarning: "<https://genenames.org/>" looks like a URL. Beautiful Soup is not an HTTP client. You should probably use an HTTP client like requests to get the document behind the URL, and feed that document to Beautiful Soup.
ERROR 2025-04-03T19:54:31.935723964Z warnings.warn(
ERROR 2025-04-03T19:54:31.935979807Z /usr/local/lib/python3.9/site-packages/bs4/__init__.py:417: MarkupResemblesLocatorWarning: "<https://www.ncbi.nlm.nih.gov/refseq/>" looks like a URL. Beautiful Soup is not an HTTP client. You should probably use an HTTP client like requests to get the document behind the URL, and feed that document to Beautiful Soup.
ERROR 2025-04-03T19:54:31.936083991Z warnings.warn(n
Noya Offer
04/06/2025, 1:24 PMThis seems related to Beautiful Soup and not Elementary related 🙂
It looks like it expects an HTML and receives a URL for some reason. Are you able to generate a report or is this a blocker?
n
Niteesh Kanungo
06/10/2025, 6:51 PMI guess I am back to this error again.
Is there a way to chunk the queries and load instead of doing it in 1 single go?
Niteesh Kanungo
06/10/2025, 6:52 PMI am using as suggested -
Copy code
# elementary limits
dbt_artifacts_chunk_size: 300
insert_rows_method: "chunk"
query_max_size: 100000
disable_dbt_columns_autoupload: true
columns_upload_strategy: none8 Views