Hi, I have just installed elementary and am runnin...
# community-support
a
Hi, I have just installed elementary and am running edr report. Getting this error:
Copy code
2024-02-06 03:32:57 — INFO — Running with edr=0.13.2
2024-02-06 03:32:59 — INFO — Running dbt --log-format json deps --project-dir C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\monitor\dbt_project
Traceback (most recent call last):
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\clients\dbt\dbt_runner.py", line 82, in _run_command
    result = subprocess.run(
             ^^^^^^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['dbt', '--log-format', 'json', 'deps', '--project-dir', 'C:\\Users\\user\\AppData\\Local\\Programs\\Python\\Python311\\Lib\\site-packages\\elementary\\monitor\\dbt_project']' returned non-zero exit status 1.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Scripts\edr.exe\__main__.py", line 7, in <module>
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 1055, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\cli\cli.py", line 67, in invoke
    return super().invoke(ctx)
           ^^^^^^^^^^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\core.py", line 760, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\click\decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\monitor\cli.py", line 406, in report
    data_monitoring = DataMonitoringReport(
                      ^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\monitor\data_monitoring\report\data_monitoring_report.py", line 42, in __init__
    super().__init__(
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\monitor\data_monitoring\data_monitoring.py", line 35, in __init__
    self.internal_dbt_runner = self._init_internal_dbt_runner()
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\monitor\data_monitoring\data_monitoring.py", line 68, in _init_internal_dbt_runner
    internal_dbt_runner = DbtRunner(
                          ^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\clients\dbt\dbt_runner.py", line 42, in __init__
    self._run_deps_if_needed()
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\clients\dbt\dbt_runner.py", line 293, in _run_deps_if_needed
    self.deps()
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\clients\dbt\dbt_runner.py", line 110, in deps
    success, _ = self._run_command(
                 ^^^^^^^^^^^^^^^^^^
  File "C:\Users\user\AppData\Local\Programs\Python\Python311\Lib\site-packages\elementary\clients\dbt\dbt_runner.py", line 93, in _run_command
    raise DbtCommandError(err, command_args, logs=logs)
elementary.exceptions.exceptions.DbtCommandError: Failed to run dbt command.
Some info edr version 0.13.2, dbt version 1.7.7 dbt deps, dbt run -s elementary:
Copy code
16:30:51  Finished running 15 incremental models, 1 table model, 14 view models, 2 hooks in 0 hours 1 minutes and 36.94 seconds (96.94s).
16:30:51
16:30:51  Completed with 1 error and 0 warnings:
16:30:51
16:30:51    Runtime Error in model information_schema_columns (models\edr\dbt_artifacts\information_schema_columns.sql)
  [UC_NOT_ENABLED] Unity Catalog is not enabled on this cluster.
dbt test:
Copy code
16:39:48  Finished running 4 tests, 2 hooks in 0 hours 0 minutes and 13.62 seconds (13.62s).
16:39:48
16:39:48  Completed with 1 error and 0 warnings:
16:39:48
16:39:48  Failure in test not_null_my_first_dbt_model_id (models\example\schema.yml)
16:39:48    Got 1 result, configured to fail if != 0
Plugins: - databricks: 1.7.3 - Up to date! profiles:
Copy code
jaffle_shop:
  outputs:
    dev:
      host: adb-1997...338.18.azuredatabricks.net
      http_path: sq...5y1
      schema: default
      threads: 1
      type: databricks
      token: d...8
  target: dev
elementary:
  outputs:
    default:
      type: "databricks"
      host: "adb-1997...338.18.azuredatabricks.net"
      http_path: "sq...5y1"
      catalog: "hive_metastore"
      schema: "default_elementary"
      token: "d...8"
      threads: 1
project yaml:
Copy code
# Name your project! Project names should contain only lowercase characters
# and underscores. A good package name should reflect your organization's
# name or the intended use of these models
name: 'jaffle_shop'
version: '1.0.0'
config-version: 2

# This setting configures which "profile" dbt uses for this project.
profile: 'jaffle_shop'

# These configurations specify where dbt should look for different types of files.
# The `model-paths` config, for example, states that models in this project can be
# found in the "models/" directory. You probably won't need to change these!
model-paths: ["models"]
analysis-paths: ["analyses"]
test-paths: ["tests"]
seed-paths: ["seeds"]
macro-paths: ["macros"]
snapshot-paths: ["snapshots"]

clean-targets:         # directories to be removed by `dbt clean`
  - "target"
  - "dbt_packages"


# Configuring models
# Full documentation: <https://docs.getdbt.com/docs/configuring-models>

# In this example config, we tell dbt to build all models in the example/
# directory as views. These settings can be overridden in the individual model
# files using the `{{ config(...) }}` macro.
models:
  jaffle_shop:
    # Config indicated by + and applies to all files under models/example/
    example:
      +materialized: view
  ## see docs: <https://docs.elementary-data.com/>
  elementary:
    ## elementary models will be created in the schema '<your_schema>_elementary'
    +schema: "elementary"
still stuck with this if any1 has any ideas...
o
This issue stems from the fact that
dbt run -s elementary
fails, can you share your
dbt.log
file with me? (you can do so privately if you prefer)
j
Hi - I have just posted the same issue. Could you please share how this issue was resolved? Many thanks
o
From a bit of online research, it seems it might be an issue with the databricks configuration. I dont really have much experience with databricks, does any of these threads make sense to you? https://stackoverflow.com/questions/74570731/unity-catalog-not-enabled-on-cluster-in-databricks https://stackoverflow.com/questions/73696068/dbt-on-databricks-unity-catalog https://community.databricks.com/t5/data-governance/uc-not-enabled-unity-catalog-is-not-enabled-on-this-cluster/td-p/6550