Hi folks! I have a question, is it possible to create a transformation with the self-hostes UI? I don't find the option and not sure if it's just me or it's a service given only for the cloud configurations. Thanks!

im trying to integrate rudderstack for my android app, previously i didn't facing error while pushing message, when the source config has the write key. Now I am getting an error. We are using the latest sample code of Kotlin(https://meet.google.com/linkredirect?authuser=0&dest=https%3A%2F%2Fgithub.com%2Frudderlabs%2Frudder-sdk-android) Edit Working now after adding ControlPlaneUrl

Failed to fetch server config for writeKey: xxxxxx

Hi, previously I had issues with Google BigQuery permissions, resulting in a lot of backlogged warehouse data. @narrow-rain-89253 helped me debug and fix this problem. Things seem to be working again, but it's taking a lot longer than I expected. Every row in wh_uploads is taking an hour to process and I have about 60 rows left. Is there some way I can easily expand capacity and speed up processing here?

I'm on K8s

Hi Support folks! This might be a silly question, but I'm not sure if we need to pay for RudderStack if we host it ourselves. I could see pricing for RudderStack Cloud, but not for self-hosting.

Followup question: Are there any feature differences of choosing to self-host over using RudderStack Cloud?

Hey @little-balloon-10936 thanks for joining our community. The open-source version of RudderStack is completely free to host. We also have a paid version of RudderStack code that has additional features like multi-node support (needed for scale/HA), event-replay, Grafana dashboards, customer-success-manager plus a few more features currently in beta (warehouse-as-a-source, cloud-sources etc. This version powers both RudderStack cloud as well as can be run inside your VPC

More details here https://rudderstack.com/pricing/

Happy to do a call and chat more. What are you thinking of using RudderStack for?

We have an existing CDP that we've built internally that we've been using, but it's starting to become a maintenance burden. I think we'd be more likely to self-host than to use the Cloud version. Thanks for the quick response!

You are welcome! Both the enterprise version and the open-source version can be self-hosted - so choice mostly depends on your scale requirements.

Gotcha. What are the throughput thresholds for open-source and enterprise? I believe we have ~150 mil events running through our CDP per month atm. Could the open-source version support that?

Kind of depends on the peak traffic too. Our default config Kubernetes single node open-source version should be able to handle 100 events/sec sending to 1-2 destinations easily. That kind of 250M events/month. However, if your peak traffic is much higher than average you may need the multi-node version. You can also try tweaking the default Kubernetes settings of our single-node-version to push more - happy to help there

how do i set anonymousId in android project. For me

RudderClient.setAnonymousId("ANONYMOUS_ID");

this line is showing error Unresolved reference: setAnonymousId

Hello everyone. I'm trying to setup rudder-server on my local machine using docker. The control plane is set up using webhook destination from android source. I get this error when trying to run rudder-server:

panic: runtime error: invalid memory address or nil pointer dereference
backend_1        | [signal SIGSEGV: segmentation violation code=0x1 addr=0x60 pc=0x138ff37]
backend_1        |
backend_1        | goroutine 169 [running]:
backend_1        | <http://github.com/rudderlabs/rudder-server/router.(*NetHandleT).Setup(0xc00046edc0|github.com/rudderlabs/rudder-server/router.(*NetHandleT).Setup(0xc00046edc0>, 0xc00058e2c0, 0x7, 0x6fc23ac00)
backend_1        | 	/codebuild/output/src071533720/src/github.com/rudderlabs/rudder-server/router/network.go:161 +0x217
backend_1        | <http://github.com/rudderlabs/rudder-server/router.(*HandleT).Setup(0xc00086e000|github.com/rudderlabs/rudder-server/router.(*HandleT).Setup(0xc00086e000>, 0xc00000a3c0, 0xc00058e2c0, 0x7)
backend_1        | 	/codebuild/output/src071533720/src/github.com/rudderlabs/rudder-server/router/router.go:1033 +0x3e1
backend_1        | main.monitorDestRouters(0xc00000a3c0, 0xc00000a5a0)
backend_1        | 	/codebuild/output/src071533720/src/github.com/rudderlabs/rudder-server/main.go:123 +0x76d
backend_1        | created by main.StartRouter
backend_1        | 	/codebuild/output/src071533720/src/github.com/rudderlabs/rudder-server/main.go:259 +0xbe

Can anyone help?

Is clickhouse destination not supported on the OSS version? for some reason clickhouse does not show up under destinations

is the ruby client utilize a different worker queue than segment's? I thought i remember being roughly a fork

Hi, I'm running rudder-server with webhook destination, but got this error in rudder-server, ERROR Errored when sending request to the serverPost http://localhost:4000: dial tcp 127.0.0.14000 connect: connection refused, that server on port 4000 already exist and working if i hit with insomnia, any way to solve this? thanks.

Hi, I am trying to connect a postgres destination to my source (using the Cloud plattform). Ruddently currently supports S3 buckets for storing intermediate files... is it planned to support Digitalocean Spaces too (as it is compatible with S3) in the near future? Thank you.

Is there an endpoint to get the

sourceConfig

from the control plane? I don't see this anywhere in the documentation. I'm able to download the config, but not access it from an API

Hi, how to change rudder-server config generator control panel port from http://localhost:3000 to another port, is it possible?, thanks.

Hi @best-holiday-32430, you can mention port like this

PORT={port} npm start

. the default is 3000

Hi, can someone help, what should url i fill in the CONFIG_PLANE_URL for self-hosted?

configUrl:  CONFIG_PLANE_URL

Thanks

hi all, i was overwhelmed by this messages:

backend_1        | 2020-12-14T04:02:16.664Z     DEBUG   jobsdb/jobsdb.go:1461   [getProcessedJobsDS] Empty cache hit for ds: {gw_jobs_40 gw_job_status_40 40}, stateFilters: [failed], customValFilters: [GW], parameterFilters: []
backend_1        | 2020-12-14T04:02:16.664Z     DEBUG   jobsdb/jobsdb.go:1581   [getUnprocessedJobsDS] Empty cache hit for ds: {gw_jobs_40 gw_job_status_40 40}, stateFilters: NP, customValFilters: [GW], parameterFilters: []
backend_1        | 2020-12-14T04:02:16.664Z     DEBUG   processor/processor.go:949      Processor DB Read Complete. No GW Jobs to process.
backend_1        | 2020-12-14T04:02:16.814Z     DEBUG   jobsdb/jobsdb.go:1461   [getProcessedJobsDS] Empty cache hit for ds: {gw_jobs_40 gw_job_status_40 40}, stateFilters: [failed], customValFilters: [GW], parameterFilters: []
backend_1        | 2020-12-14T04:02:16.814Z     DEBUG   jobsdb/jobsdb.go:1581   [getUnprocessedJobsDS] Empty cache hit for ds: {gw_jobs_40 gw_job_status_40 40}, stateFilters: NP, customValFilters: [GW], parameterFilters: []
backend_1        | 2020-12-14T04:02:16.814Z     DEBUG   processor/processor.go:949      Processor DB Read Complete. No GW Jobs to process.
backend_1        | 2020-12-14T04:02:16.928Z     DEBUG   pgnotifier/pgnotifier.go:125    PgNotifier: triggering pending jobs
backend_1        | 2020-12-14T04:02:17.124Z     DEBUG   jobsdb/jobsdb.go:1461   [getProcessedJobsDS] Empty cache hit for ds: {gw_jobs_40 gw_job_status_40 40}, stateFilters: [failed], customValFilters: [GW], parameterFilters: []
backend_1        | 2020-12-14T04:02:17.124Z     DEBUG   jobsdb/jobsdb.go:1581   [getUnprocessedJobsDS] Empty cache hit for ds: {gw_jobs_40 gw_job_status_40 40}, stateFilters: NP, customValFilters: [GW], parameterFilters: []

how can i disable that empty cache hit?

one thing, i didn't see these tables in the rudder db:

gw_jobs_40

,

gw_job_status_40

but, i saw this tables:

gw_jobs_39

and

gw_job_status_39

and, how can i clean the processed cache data under /tmp/ directory

😄

when loading data to a data warehouse, why is the sync time so long ? Sync starts at 30 minutes (or longer). Is there any way to tune this setting to a lower amount? Say 5 minutes?

Hi, is there a way to add some key and value in rudder-sdk-js when load so that all the events will send along with that value?, for example rudderanalytics.load(key,url,{scope:"A"}), so scope:"A" will attached in every event body.