Ahmed M
02/05/2024, 4:42 PM2024-02-06 03:32:57 — INFO — Running with edr=0.13.2
2024-02-06 03:32:59 — INFO — Running dbt --log-format json deps --project-dir C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\monitor\dbt_project
Traceback (most recent call last):
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\clients\dbt\dbt_runner.py", line 82, in _run_command
result = subprocess.run(
^^^^^^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['dbt', '--log-format', 'json', 'deps', '--project-dir', 'C:\\Users\\user\\AppData\\Local\\Programs\\Python\\Python311\\Lib\\site-packages\\elementary\\monitor\\dbt_project']' returned non-zero exit status 1.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Scripts\edr.exe\__main__.py", line 7, in <module>
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 1130, in __call__
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 1055, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\cli\cli.py", line 67, in invoke
return super().invoke(ctx)
^^^^^^^^^^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 1657, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 760, in invoke
return __callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\decorators.py", line 26, in new_func
return f(get_current_context(), *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\monitor\cli.py", line 406, in report
data_monitoring = DataMonitoringReport(
^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\monitor\data_monitoring\report\data_monitoring_report.py", line 42, in __init__
super().__init__(
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\monitor\data_monitoring\data_monitoring.py", line 35, in __init__
self.internal_dbt_runner = self._init_internal_dbt_runner()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\monitor\data_monitoring\data_monitoring.py", line 68, in _init_internal_dbt_runner
internal_dbt_runner = DbtRunner(
^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\clients\dbt\dbt_runner.py", line 42, in __init__
self._run_deps_if_needed()
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\clients\dbt\dbt_runner.py", line 293, in _run_deps_if_needed
self.deps()
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\clients\dbt\dbt_runner.py", line 110, in deps
success, _ = self._run_command(
^^^^^^^^^^^^^^^^^^
File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\clients\dbt\dbt_runner.py", line 93, in _run_command
raise DbtCommandError(err, command_args, logs=logs)
elementary.exceptions.exceptions.DbtCommandError: Failed to run dbt command.
Some info edr version 0.13.2, dbt version 1.7.7
dbt deps,
dbt run -s elementary:
16:30:51 Finished running 15 incremental models, 1 table model, 14 view models, 2 hooks in 0 hours 1 minutes and 36.94 seconds (96.94s).
16:30:51
16:30:51 Completed with 1 error and 0 warnings:
16:30:51
16:30:51 Runtime Error in model information_schema_columns (models\edr\dbt_artifacts\information_schema_columns.sql)
[UC_NOT_ENABLED] Unity Catalog is not enabled on this cluster.
dbt test:
16:39:48 Finished running 4 tests, 2 hooks in 0 hours 0 minutes and 13.62 seconds (13.62s).
16:39:48
16:39:48 Completed with 1 error and 0 warnings:
16:39:48
16:39:48 Failure in test not_null_my_first_dbt_model_id (models\example\schema.yml)
16:39:48 Got 1 result, configured to fail if != 0
Plugins:
- databricks: 1.7.3 - Up to date!
profiles:
jaffle_shop:
outputs:
dev:
host: adb-1997...338.18.azuredatabricks.net
http_path: sq...5y1
schema: default
threads: 1
type: databricks
token: d...8
target: dev
elementary:
outputs:
default:
type: "databricks"
host: "adb-1997...338.18.azuredatabricks.net"
http_path: "sq...5y1"
catalog: "hive_metastore"
schema: "default_elementary"
token: "d...8"
threads: 1
project yaml:
# Name your project! Project names should contain only lowercase characters
# and underscores. A good package name should reflect your organization's
# name or the intended use of these models
name: 'jaffle_shop'
version: '1.0.0'
config-version: 2
# This setting configures which "profile" dbt uses for this project.
profile: 'jaffle_shop'
# These configurations specify where dbt should look for different types of files.
# The `model-paths` config, for example, states that models in this project can be
# found in the "models/" directory. You probably won't need to change these!
model-paths: ["models"]
analysis-paths: ["analyses"]
test-paths: ["tests"]
seed-paths: ["seeds"]
macro-paths: ["macros"]
snapshot-paths: ["snapshots"]
clean-targets: # directories to be removed by `dbt clean`
- "target"
- "dbt_packages"
# Configuring models
# Full documentation: <https://docs.getdbt.com/docs/configuring-models>
# In this example config, we tell dbt to build all models in the example/
# directory as views. These settings can be overridden in the individual model
# files using the `{{ config(...) }}` macro.
models:
jaffle_shop:
# Config indicated by + and applies to all files under models/example/
example:
+materialized: view
## see docs: <https://docs.elementary-data.com/>
elementary:
## elementary models will be created in the schema '<your_schema>_elementary'
+schema: "elementary"Ahmed M
02/06/2024, 12:58 AMOfek Weiss
02/07/2024, 8:00 AMdbt run -s elementary fails, can you share your dbt.log file with me? (you can do so privately if you prefer)Jake Duhigg
02/26/2024, 11:56 AMOfek Weiss
03/20/2024, 9:31 AM