general
  • Minura Punchihewa

    Minura Punchihewa

    10/08/2022, 7:43 PM
    I was hoping you guys would be able to help me with something. I am trying to connect to Databend using Python.
  • Minura Punchihewa

    Minura Punchihewa

    10/08/2022, 7:44 PM
    I have access to a hosted instance of Databend through the Early Access Program.
  • Minura Punchihewa

    Minura Punchihewa

    10/08/2022, 7:44 PM
    How can I connect to it using Python?
  • Minura Punchihewa

    Minura Punchihewa

    10/08/2022, 7:44 PM
    I have tried following the steps given here,https://databend.rs/doc/develop/python But, no luck.
  • Yazhou

    Yazhou

    10/09/2022, 3:25 AM
    the Databend Cloud supports the Clickhouse HTTP protocol, so the existed clickhouse drivers like clickhouse-sqlalchemy, mailru/go-clickhouse can be taken advantaged of.
  • Yazhou

    Yazhou

    10/09/2022, 3:29 AM
    We're also developing our own drivers with customized HTTP protocol to make the connection with some improvements like paginated response, auto-reconnect, staged insert with exactly once semantics, etc. may help us developing ETL tasks easier!
  • Minura Punchihewa

    Minura Punchihewa

    10/09/2022, 6:39 AM
    @Xuanwo @Yazhou Thank you so much for the material! These work great!
  • Yazhou

    Yazhou

    10/09/2022, 6:44 AM
    you can also connect Databend Cloud with Deepnote, Metabase, Hex, Mindsdb, etc. with the connection credentials from a warehouse 😃
  • Minura Punchihewa

    Minura Punchihewa

    10/09/2022, 8:16 AM
    Got it. Thanks. Is it also possible to connect to self-hosted Databend using the Clickhouse HTTP protocol?
  • u

    user

    10/09/2022, 8:17 AM
    integrate databend with python: https://databend.rs/doc/develop/python
  • PsiACE

    PsiACE

    10/13/2022, 1:58 AM
    This week in Databend #63: A Modern Cloud Data Warehouse for Everyone The new weekly report has been released, so let's see what's new! 👋🏻
  • u

    user

    10/13/2022, 2:39 AM
    OpenDAL v0.19.2 has been released!https://github.com/datafuselabs/opendal/discussions/859 In v0.19.2, we: - Allow use moka-rs as backend - Add concurrent limit support - Add basic content cache support
  • u

    user

    10/19/2022, 4:23 AM
  • Xuanwo

    Xuanwo

    10/19/2022, 4:25 AM
    added an integration to this channel: linen.dev
  • PsiACE

    PsiACE

    10/20/2022, 2:48 AM
    https://weekly.databend.rs/2022-10-19-databend-weekly/ The new weekly report has been released, and we are currently working on the implementation of the new Cache solution
  • PsiACE

    PsiACE

    10/27/2022, 3:19 AM
    https://weekly.databend.rs/2022-10-26-databend-weekly/ This week's fresh news includes: • RFC: Multiple Catalog • Jepsen Test for Databend Meta Service This week's recommended series of Issues are: • New Key-Value services support for OpenDAL
  • PsiACE

    PsiACE

    11/03/2022, 2:53 AM
    https://weekly.databend.rs/2022-11-02-databend-weekly/ This week's fresh news includes: • String Adaptive Hash Table • RFC: User Stage This week's recommended Issue is: • Replace
    RwLock<HashMap>
    and
    Mutex<HashMap>
    by Using DashMap
  • PsiACE

    PsiACE

    11/10/2022, 2:08 AM
    https://weekly.databend.rs/2022-11-09-databend-weekly/ This week's fresh news includes: - Support Copy from XML - Support for Char Collation This week's recommended Issue is: - Enable Xor Filter Index for IN
  • y

    Yp Xie

    11/10/2022, 3:58 AM
    Hi team, I’m new to Databend, and I found the whole design arch is fabulous! I’m excited to see we have a such great design in open source data warehouse community. When I tried to deploy a standalone Databend with AWS EC2 and S3, I found there’s no way to use an IAM based authentication method to access S3, we have to put explicit
    access_key_id
    and
    secret_access_key
    in the configuration, but I think this is not always available for most production env. So my question is that is there any methods we can use IAM based authentication to setup the S3 integration? thanks
  • Xuanwo

    Xuanwo

    11/10/2022, 4:16 AM
    @Yp Xie By starting databend-query with environment RUST_LOG=debug, we can read the debug message on load s3 credential. Please feel free to ping me if anything goes wrongly~
  • y

    Yp Xie

    11/10/2022, 7:48 AM
    cool, looking forward!
  • y

    Yp Xie

    11/14/2022, 2:30 AM
    yes, it would help a lot if IMDSv2 is supported
  • PsiACE

    PsiACE

    11/17/2022, 3:29 AM
    https://weekly.databend.rs/2022-11-16-databend-weekly/ This week's fresh news includes: - Support Parallel Final Aggregator, 4X Faster! - Shuffle Policy for Partitions - Databend x Rust China Hackathon 2022 This week's recommended Issue is: - Switch to nextest in CI
  • bohu

    bohu

    11/24/2022, 2:07 AM
    New post: Replace Bloom Filter with Xor Filter to Speed up Queries https://databend.rs/blog/xor-filter
  • PsiACE

    PsiACE

    11/24/2022, 6:30 AM
    https://weekly.databend.rs/2022-11-23-databend-weekly/ This week's fresh news includes:- Preview of New Expressions: Geo Functions - Unset Settings This week's recommended Issue is:- Add Compression Option to Create Table
  • River wubx

    River wubx

    11/30/2022, 10:22 AM
    Speed up hive queries with databend https://databend.rs/blog/hive%20on%20databend
  • PsiACE

    PsiACE

    12/02/2022, 3:39 AM
    https://databend.rs/blog/2022-11-30-databend-weekly What's On In Databend • Infer Schema at a Glance Good First Issue • Add Tls Support for Mysql Handler