https://linen.dev logo
Join Slack
Powered by
Hey, I am trying to generate report, but I got som...
# community-support
m
Hey, I am trying to generate report, but I got some weird error. I even recreated elementary schema fully, but it is still the same.
Copy code
root@8edac34abe81:/project# dbt run --select elementary --full-refresh
07:09:26  Running with dbt=1.7.7
07:09:28  Registered adapter: redshift=1.7.3
07:09:28  Unable to do partial parsing because a project config has changed
07:09:54  [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
There are 1 unused configuration paths:
- seeds.core
07:09:55  Found 43 models, 1 seed, 2 operations, 14 tests, 11 sources, 1 exposure, 0 metrics, 1190 macros, 0 groups, 0 semantic models
07:09:55  
07:10:02  
07:10:02  Running 1 on-run-start hook
07:10:02  1 of 1 START hook: elementary.on-run-start.0 ................................... [RUN]
07:10:02  1 of 1 OK hook: elementary.on-run-start.0 ...................................... [OK in 0.00s]
07:10:02  
07:10:02  Concurrency: 2 threads (target='dev')
07:10:02  
07:10:02  1 of 30 START sql incremental model elementary.data_monitoring_metrics ......... [RUN]
07:10:02  2 of 30 START sql incremental model elementary.dbt_columns ..................... [RUN]
07:10:14  1 of 30 OK created sql incremental model elementary.data_monitoring_metrics .... [SUCCESS in 11.43s]
07:10:14  3 of 30 START sql incremental model elementary.dbt_exposures ................... [RUN]
07:10:29  3 of 30 OK created sql incremental model elementary.dbt_exposures .............. [SUCCESS in 14.77s]
07:10:29  4 of 30 START sql incremental model elementary.dbt_invocations ................. [RUN]
07:10:41  4 of 30 OK created sql incremental model elementary.dbt_invocations ............ [SUCCESS in 12.53s]
07:10:41  5 of 30 START sql incremental model elementary.dbt_metrics ..................... [RUN]
07:10:43  2 of 30 OK created sql incremental model elementary.dbt_columns ................ [SUCCESS in 40.81s]
07:10:43  6 of 30 START sql incremental model elementary.dbt_models ...................... [RUN]
07:10:51  5 of 30 OK created sql incremental model elementary.dbt_metrics ................ [SUCCESS in 9.62s]
07:10:51  7 of 30 START sql incremental model elementary.dbt_run_results ................. [RUN]
07:10:59  7 of 30 OK created sql incremental model elementary.dbt_run_results ............ [SUCCESS in 7.53s]
07:10:59  8 of 30 START sql incremental model elementary.dbt_seeds ....................... [RUN]
07:11:00  6 of 30 OK created sql incremental model elementary.dbt_models ................. [SUCCESS in 16.32s]
07:11:00  9 of 30 START sql incremental model elementary.dbt_snapshots ................... [RUN]
07:11:10  9 of 30 OK created sql incremental model elementary.dbt_snapshots .............. [SUCCESS in 10.58s]
07:11:10  10 of 30 START sql incremental model elementary.dbt_source_freshness_results ... [RUN]
07:11:12  8 of 30 OK created sql incremental model elementary.dbt_seeds .................. [SUCCESS in 13.38s]
07:11:12  11 of 30 START sql incremental model elementary.dbt_sources .................... [RUN]
07:11:22  10 of 30 OK created sql incremental model elementary.dbt_source_freshness_results  [SUCCESS in 12.09s]
07:11:22  12 of 30 START sql incremental model elementary.dbt_tests ...................... [RUN]
07:11:29  11 of 30 OK created sql incremental model elementary.dbt_sources ............... [SUCCESS in 17.28s]
07:11:29  13 of 30 START sql incremental model elementary.elementary_test_results ........ [RUN]
07:11:40  13 of 30 OK created sql incremental model elementary.elementary_test_results ... [SUCCESS in 10.52s]
07:11:40  14 of 30 START sql table model elementary.metadata ............................. [RUN]
07:11:40  12 of 30 OK created sql incremental model elementary.dbt_tests ................. [SUCCESS in 17.64s]
07:11:40  15 of 30 START sql incremental model elementary.schema_columns_snapshot ........ [RUN]
07:11:44  14 of 30 OK created sql table model elementary.metadata ........................ [SUCCESS in 4.52s]
07:11:44  16 of 30 START sql view model elementary.metrics_anomaly_score ................. [RUN]
07:11:48  16 of 30 OK created sql view model elementary.metrics_anomaly_score ............ [SUCCESS in 3.69s]
07:11:48  17 of 30 START sql view model elementary.monitors_runs ......................... [RUN]
07:11:49  15 of 30 OK created sql incremental model elementary.schema_columns_snapshot ... [SUCCESS in 8.60s]
07:11:49  18 of 30 START sql view model elementary.job_run_results ....................... [RUN]
07:11:54  17 of 30 OK created sql view model elementary.monitors_runs .................... [SUCCESS in 5.41s]
07:11:54  19 of 30 START sql view model elementary.model_run_results ..................... [RUN]
07:11:54  18 of 30 OK created sql view model elementary.job_run_results .................. [SUCCESS in 5.82s]
07:11:54  20 of 30 START sql view model elementary.snapshot_run_results .................. [RUN]
07:11:58  19 of 30 OK created sql view model elementary.model_run_results ................ [SUCCESS in 4.62s]
07:11:58  21 of 30 START sql view model elementary.alerts_dbt_source_freshness ........... [RUN]
07:11:59  20 of 30 OK created sql view model elementary.snapshot_run_results ............. [SUCCESS in 4.37s]
07:11:59  22 of 30 START sql view model elementary.information_schema_columns ............ [RUN]
07:12:02  21 of 30 OK created sql view model elementary.alerts_dbt_source_freshness ...... [SUCCESS in 3.57s]
07:12:02  23 of 30 START sql view model elementary.alerts_anomaly_detection .............. [RUN]
07:12:06  22 of 30 OK created sql view model elementary.information_schema_columns ....... [SUCCESS in 6.19s]
07:12:06  23 of 30 OK created sql view model elementary.alerts_anomaly_detection ......... [SUCCESS in 4.06s]
07:12:06  24 of 30 START sql view model elementary.alerts_dbt_tests ...................... [RUN]
07:12:06  25 of 30 START sql view model elementary.alerts_schema_changes ................. [RUN]
07:12:11  24 of 30 OK created sql view model elementary.alerts_dbt_tests ................. [SUCCESS in 4.75s]
07:12:11  26 of 30 START sql incremental model elementary.test_result_rows ............... [RUN]
07:12:11  25 of 30 OK created sql view model elementary.alerts_schema_changes ............ [SUCCESS in 5.44s]
07:12:11  27 of 30 START sql view model elementary.dbt_artifacts_hashes .................. [RUN]
07:12:15  27 of 30 OK created sql view model elementary.dbt_artifacts_hashes ............. [SUCCESS in 3.78s]
07:12:15  28 of 30 START sql view model elementary.anomaly_threshold_sensitivity ......... [RUN]
07:12:18  26 of 30 OK created sql incremental model elementary.test_result_rows .......... [SUCCESS in 7.06s]
07:12:18  29 of 30 START sql view model elementary.alerts_dbt_models ..................... [RUN]
07:12:22  28 of 30 OK created sql view model elementary.anomaly_threshold_sensitivity .... [SUCCESS in 6.63s]
07:12:22  30 of 30 START sql view model elementary.enriched_columns ...................... [RUN]
07:12:23  29 of 30 OK created sql view model elementary.alerts_dbt_models ................ [SUCCESS in 4.82s]
07:12:25  30 of 30 OK created sql view model elementary.enriched_columns ................. [SUCCESS in 3.36s]
07:12:26  
07:12:26  Running 1 on-run-end hook
07:12:43  1 of 1 START hook: elementary.on-run-end.0 ..................................... [RUN]
07:12:43  1 of 1 OK hook: elementary.on-run-end.0 ........................................ [OK in 0.00s]
07:12:43  
07:12:43  
07:12:43  Finished running 15 incremental models, 1 table model, 14 view models, 2 hooks in 0 hours 2 minutes and 48.45 seconds (168.45s).
07:12:43  
07:12:43  Completed successfully
07:12:43  
07:12:43  Done. PASS=30 WARN=0 ERROR=0 SKIP=0 TOTAL=30
root@8edac34abe81:/project# edr report -c .edr/ --profiles-dir . --profile-target prod
    ________                          __                  
   / ____/ /__  ____ ___  ___  ____  / /_____ ________  __
  / __/ / / _ \/ __ `__ \/ _ \/ __ \/ __/ __ `/ ___/ / / /
 / /___/ /  __/ / / / / /  __/ / / / /_/ /_/ / /  / /_/ / 
/_____/_/\___/_/ /_/ /_/\___/_/ /_/\__/\__,_/_/   \__, /  
                                                 /____/   

You are using Elementary 0.13.2, however version 0.14.0 is available.
Consider upgrading by running: "/usr/local/bin/python -m pip install --upgrade elementary-data"

Any feedback and suggestions are welcomed! join our community here - <https://bit.ly/slack-elementary>

2024-02-15 07:13:56 — INFO — Running with edr=0.13.2
2024-02-15 07:13:56 — INFO — Running dbt --log-format json deps --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project --profiles-dir . --target prod
2024-02-15 07:14:09 — INFO — Running with dbt=1.7.7
2024-02-15 07:14:09 — INFO — Updating lock file in file path: /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project/package-lock.yml
2024-02-15 07:14:09 — INFO — Installing dbt-labs/dbt_utils
2024-02-15 07:14:09 — INFO — Installed from version 0.8.6
2024-02-15 07:14:09 — INFO — Updated version available: 1.1.1
2024-02-15 07:14:09 — INFO — Installing elementary-data/elementary
2024-02-15 07:14:09 — INFO — Installed from version 0.13.0
2024-02-15 07:14:09 — INFO — Updated version available: 0.14.0
2024-02-15 07:14:09 — INFO — 
2024-02-15 07:14:09 — INFO — Updates available for packages: ['dbt-labs/dbt_utils', 'elementary-data/elementary']                 
Update your versions in packages.yml, then run dbt deps
2024-02-15 07:15:09 — INFO — edr (0.13.2) and Elementary's dbt package (0.13.2) are compatible.
2024-02-15 07:15:25 — INFO — Elementary's database and schema: '"rhodium.elementary"'
2024-02-15 07:15:25 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_test_results", "macro_args": {"days_back": 7, "invocations_per_test": 720, "disable_passed_test_metrics": false}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project --profiles-dir . --target prod
2024-02-15 07:15:44 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_source_freshness_results", "macro_args": {"days_back": 7, "invocations_per_test": 720}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project --profiles-dir . --target prod
2024-02-15 07:16:03 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_models", "macro_args": {"exclude_elementary": true}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project --profiles-dir . --target prod
2024-02-15 07:16:20 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_sources", "macro_args": {}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project --profiles-dir . --target prod
2024-02-15 07:16:36 — INFO — Running dbt --log-format json run-operation elementary.log_macro_results --args {"macro_name": "elementary_cli.get_exposures", "macro_args": {}} --project-dir /usr/local/lib/python3.10/site-packages/elementary/monitor/dbt_project --profiles-dir . --target prod
2024-02-15 07:16:54 — ERROR — Could not generate the report - Error: Failed to run dbt command.
Encountered an error while running operation: Database Error
  each UNION query must have the same number of columns
Please reach out to our community for help with this issue.
NoneType: None
n
Hey @Mindaugas Nižauskas! Thanks for reaching out Can you maybe share your 
dbt.log
and 
edr.log
so that I can debug a bit deeper? (I know you shared most of the log here but it’s always helpful to have the full log with all queries, this way we can easily find the relevant query where it fails and get to the issue) you can also share in a DM if you feel more comfortable with it, though for continuity here is preferred 🙂
m
edr.log is something what I already shared and dbt.log is too long, I am sending via DM
👍 1
n
For documentation and transparicy I’ll update here as well, this is a known issue which was fixed in the new 14.0 version If you’d rather avoid an upgrade a workaround is deleting the view called 
enriched_exposures
m
Thank you for your help, that solved my issue. Actually I tried both.
🙌 1
29 Views
Open in Slack
PreviousNext
Powered by