dev
  • Didip Kerabat

    Didip Kerabat

    09/06/2022, 5:27 PM
    Question, on
    DruidSqlInsert
    ,
    DruidSqlParserImplFactory
    , and
    DruidSqlParserUtils
    , I get
    ParseException cannot be resolved to a type
    error on my VSCode. Should those classes
    import java.text.ParseException
    explicitly? But that said, when I tried that, I got this error:
    The constructor ParseException(String) is undefined
    incorrect signature, basically.
  • k

    Karan Kumar

    09/09/2022, 9:34 AM
    Does anyone know how
    wikipedia_editstream
    is setup in integration tests ?
  • Amatya Avadhanula

    Amatya Avadhanula

    09/11/2022, 8:09 AM
    Sometimes, queries do not consider data due to incorrect core partition count being set during segment allocation in the same interval. This usually occurs when core partitions are dropped for an interval and data is appended in the presence of stale pending segment entries. https://github.com/apache/druid/pull/13070 attempts to fix it
  • Abhishek Agarwal

    Abhishek Agarwal

    09/12/2022, 2:38 PM
    I created a PR to move some of IT tests on JRE 11 to the cron stage - https://github.com/apache/druid/pull/13075
  • Amatya Avadhanula

    Amatya Avadhanula

    09/12/2022, 8:43 PM
    stateTransitionLock is shared for both stopping and creating new tasks in a supervisor, When a supervisor is STOPPING (set by stop), it doesn't need to create new tasks any more. However, creation of tasks may sometimes wait on the lock held by stop, and leads to a delay in execution of the run notice, which results in a timeout of the graceful shutdown period.https://github.com/apache/druid/pull/13072 attempts to help with this issue while continuing to prevent the creation of dangling tasks during supervisor termination
  • Clint Wylie

    Clint Wylie

    09/13/2022, 8:59 PM
    travis might break on any open PRs, https://github.com/apache/druid/pull/13083 should fix
  • Tijo Thomas

    Tijo Thomas

    09/15/2022, 6:32 AM
    @Tijo Thomas has joined the channel
  • Amatya Avadhanula

    Amatya Avadhanula

    09/15/2022, 12:44 PM
    https://github.com/apache/druid/pull/13092 is an attempt to make http based TaskRunner, LoadQueue and ServerInventoryView as the default in Druid
  • Clint Wylie

    Clint Wylie

    09/16/2022, 10:59 PM
    sweet perf improvement for nested column serializer for sparse schemas https://github.com/apache/druid/pull/13101
  • Laksh Singla

    Laksh Singla

    09/20/2022, 4:34 AM
    Travis builds on my open PRs have been stalling since yesterday. Is anyone else facing the same?
  • Vadim

    Vadim

    09/20/2022, 5:19 AM
    Yup
  • Tejaswini Bandlamudi

    Tejaswini Bandlamudi

    09/26/2022, 10:35 AM
    Hello, Here is a PR to introduce idle feature in Seekable stream supervisors if stream is inactive for a while. Please provide your feedback. https://github.com/apache/druid/pull/13144
  • Abhishek Agarwal

    Abhishek Agarwal

    09/28/2022, 9:45 AM
    https://github.com/apache/druid/pull/13151 - Minor fix for a sql planning bug.
  • Abhishek Agarwal

    Abhishek Agarwal

    09/28/2022, 10:20 AM
    does anyone know a thing about our Algolia setup?
  • Abhishek Agarwal

    Abhishek Agarwal

    09/28/2022, 10:20 AM
  • Clint Wylie

    Clint Wylie

    09/29/2022, 10:14 AM
    performance on this is looking pretty nice now 🚀 https://github.com/apache/druid/pull/12277
  • Cory Johannsen

    Cory Johannsen

    10/03/2022, 10:26 PM
    I have a PR for the kubernetes extension to upgrade the kubernetes client jar to latest and address the changes introduced by the version bump: https://github.com/apache/druid/pull/13175. This change is running inside our infrastructure now and so far is stable. As this is my first PR, I'd love any input on improvements I can make.
  • Cory Johannsen

    Cory Johannsen

    10/03/2022, 10:46 PM
  • Abhishek Agarwal

    Abhishek Agarwal

    10/04/2022, 6:00 AM
  • Cory Johannsen

    Cory Johannsen

    10/10/2022, 11:45 PM
    I have observed that
    ChangeRequestHttpSyncer
    that perform sync operations with segments has not maximum failure limit, and will retry indefinitely to sync with a node. The issue I have been diagnosing is that the node no longer exists and will never come back; the underlying kubernetes pod is gone and the IP address is either no longer in use or recycled to another pod. I am assuming that the segment should have unannounced itself, but I'm wondering if that failed to occur. The end result is that a sync thread is running indefinitely attempting to talk to a host that will never return. In this case there is a
    NoRouteToHost
    that identifies that the host is gone:
    Caused by: java.net.NoRouteToHostException: Host is unreachable
    With enough pod churn this eventually consumes all the threads on coordinator http client pool and coordinator stops responding to requests, so not having a fail-safe seems like this is inevitable.
  • kfaraz

    kfaraz

    10/25/2022, 7:49 AM
    Travis builds have been failing typically in the license check and packaging check steps due to python version mismatches. This has been fixed in https://github.com/apache/druid/pull/13257 and merged to master. Please merge the latest master into your PRs to ensure that they build successfully.
  • Didip Kerabat

    Didip Kerabat

    10/29/2022, 4:11 PM
    Heya folks, was just wondering if there’s anything else I need to do here. The PR has been sitting for a while.https://github.com/apache/druid/pull/13027#issuecomment-1295748619
  • Didip Kerabat

    Didip Kerabat

    11/03/2022, 3:08 PM
    Good morning folks! Apache Curator 5.4.0 is finally released!https://github.com/apache/druid/pull/13302
  • Amatya Avadhanula

    Amatya Avadhanula

    11/03/2022, 4:40 PM
    Hi, https://github.com/apache/druid/pull/13304 is a quick fix to prevent coordinator crashes described in https://github.com/apache/druid/issues/13208.
  • Amatya Avadhanula

    Amatya Avadhanula

    11/05/2022, 3:46 AM
    https://github.com/apache/druid/pull/13315 fixes the flaky UT: testResumeAllActivelyReadingTasks
  • s

    Samarth Jain

    11/16/2022, 10:31 PM
    Is vectorization supported for complex type columns? Looking at the
    VectorValueSelector
    interface, it seems like only primitive columns are supported.
  • Abhishek Agarwal

    Abhishek Agarwal

    11/23/2022, 11:15 AM
    do we consider all
    contrib
    extensions experimental? Reviewing this PR https://github.com/apache/druid/pull/13348/files#diff-f4ca21313f7523b8be9efd16ea196bd1426a143fdbf9422d3560643ff69e275f right now that lists experimental features. I think that we need not list the
    contrib
    extensions here at all.
  • Didip Kerabat

    Didip Kerabat

    11/28/2022, 7:53 PM
    Question, will Github Actions be faster and more reliable than TravisCI? If the project can already use Github Actions (is it free?) I can take a stab at it if y’all think it’s worth it.