Hi folks, I am working on connecting my Pinot data...
# troubleshooting
s
Hi folks, I am working on connecting my Pinot database with Superset .I am able to connect my database with superset and is able to run query in the SQL Editor section of the superset UI but unable to create charts and access the Explore section of the UI . Is it due the fact that I have JSON column in the table ? plz help
Screenshot 2022-06-14 at 12.49.16 PM.png
m
Can you run a simple count(*) query?
s
Yes that is working fine Also when I trying to see table schema from left it gives error unable to fetch table metadata
Also cc: @Xiang Fu
s
2022-06-14 08:42:48,748:ERROR:root:'json'
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/flask_appbuilder/api/__init__.py", line 85, in wraps
return f(self, *args, **kwargs)
File "/app/superset/views/base_api.py", line 112, in wraps
raise ex
File "/app/superset/views/base_api.py", line 109, in wraps
duration, response = time_function(f, self, *args, **kwargs)
File "/app/superset/utils/core.py", line 1429, in time_function
response = func(*args, **kwargs)
File "/app/superset/utils/log.py", line 242, in wrapper
value = f(*args, **kwargs)
File "/app/superset/views/base_api.py", line 82, in wraps
return f(self, *args, **kwargs)
File "/app/superset/datasets/api.py", line 253, in post
new_model = CreateDatasetCommand(g.user, item).run()
File "/app/superset/datasets/commands/create.py", line 46, in run
self.validate()
File "/app/superset/datasets/commands/create.py", line 86, in validate
if database and not DatasetDAO.validate_table_exists(
File "/app/superset/datasets/dao.py", line 81, in validate_table_exists
database.get_table(table_name, schema=schema)
File "/app/superset/models/core.py", line 659, in get_table
return Table(
File "<string>", line 2, in __new__
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/util/deprecations.py", line 139, in warned
return fn(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/sql/schema.py", line 563, in __new__
metadata._remove_table(name, schema)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/util/langhelpers.py", line 68, in __exit__
compat.raise_(
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/util/compat.py", line 182, in raise_
raise exception
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/sql/schema.py", line 558, in __new__
table._init(name, metadata, *args, **kw)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/sql/schema.py", line 647, in _init
self._autoload(
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/sql/schema.py", line 670, in _autoload
autoload_with.run_callable(
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 2212, in run_callable
return conn.run_callable(callable_, *args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1653, in run_callable
return callable_(self, *args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/default.py", line 484, in reflecttable
return insp.reflecttable(
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/reflection.py", line 664, in reflecttable
for col_d in self.get_columns(
File "/usr/local/lib/python3.8/site-packages/sqlalchemy/engine/reflection.py", line 390, in get_columns
col_defs = self.dialect.get_columns(
File "/usr/local/lib/python3.8/site-packages/pinotdb/sqlalchemy.py", line 205, in get_columns
columns = [
File "/usr/local/lib/python3.8/site-packages/pinotdb/sqlalchemy.py", line 208, in <listcomp>
"type": get_type(spec["dataType"], spec.get("fieldSize")),
File "/usr/local/lib/python3.8/site-packages/pinotdb/sqlalchemy.py", line 273, in get_type
return type_map[data_type.lower()]
KeyError: 'json'
These are log file error that are there.
x
which pinotdb version you installed ?
can you try 0.3.11
s
I am using pinot 0.9.3
when I m removing the json column from the tables then I am able to create dataset and hence charts from the tables but when json columns are there then I am not able to create dataset .Is it possible superset does not support json indexed or json column data exploration
x
right, in superset , how do you install pinotdb python client?
this 0.3.11 is pinotdb python client installed in superset
you need to check superset container for the version