RudderStack #support

worried-plumber-47973

02/11/2022, 8:58 AM

Hi everyone, we are using opensource rudderserver deployed on our ec2 instances via docker compose. From the last few days rudderstack data is not being inserted into redshift. 1. One possible problem might have been our WLM queue config, we were using the default priority queue. Now we have made writes as highest priority which should fix things. But we are still seeing errors like this in the logs

Copy code

2022-02-11T08:48:11.767Z	ERROR	[WH] Upload: 8752, TargetState: exported_data, NewState: exporting_data_failed, Error: 1 errors occurred:
1 errors occurred:
Skipping tracks table because it previously failed to load in an earlier job: 8748
2022-02-11T08:48:11.767Z	ERROR	[WH]: Failed during exporting_data_failed stage: 1 errors occurred:
1 errors occurred:
Skipping tracks table because it previously failed to load in an earlier job: 8748

and

Copy code

2022-02-11T11:02:29.895Z	ERROR	WH: RS:  Error dropping dangling staging table: rudder_staging_fb101f97faf94fea98ba0b8d693d4071_application_backgrounded in redshift: pq: Table "rudder_staging_fb101f97faf94fea98ba0b8d693d4071_application_backgrounded" does not exist

and

Copy code

2022-02-11T14:13:30.989Z	INFO	ProcessorDBWrite: Total: 272962 Overall:271.375022, Instant(print):300.215385, Instant(call):388.042095
2022-02-11T14:13:31.144Z	ERROR	[WH] Failed in handle Upload jobs for worker: %!w(*fmt.wrapError=&{Upload Job failed: 1 errors occurred:
1 errors occurred:
Skipping identifies table because it previously failed to load in an earlier job: 8850 +0xc00012f700})
2022-02-11T14:13:31.336Z	ERROR	[WH] Failed in handle Upload jobs for worker: %!w(*fmt.wrapError=&{Upload Job failed: 2 errors occurred:
1 errors occurred:
pq: 1023
4 errors occurred:
pq: 1023
pq: 1023
pq: 1023
pq: 1023 +0xc00fd38b20})

Any suggestion on how to fix these errors?

refined-sundown-5100

02/11/2022, 1:58 PM

Hi everyone! Between 10th and 12th January, we identified unexpected event's volume coming from rudder to other tools from our stack. Do you have an indication of rudder status these days? Thank you in advance!

🎫 1

bulky-kilobyte-26698

02/12/2022, 3:40 PM

Rudderstack is totally broken for me, appreciate some help:

Copy code

backend_1        | 2022-02-12T15:35:49.816Z	ERROR	write udp 127.0.0.1:56527->127.0.0.1:8125: write: connection refused
backend_1        | 2022-02-12T15:35:49.817Z	ERROR	write udp 127.0.0.1:34064->127.0.0.1:8125: write: connection refused
backend_1        | 2022-02-12T15:35:54.544Z	ERROR	Incompatible transformer version: Expected: 1 Received: 2, URL: <http://d-transformer:9090/customTransform>
backend_1        | 2022-02-12T15:35:54.550Z	ERROR	Incompatible transformer version: Expected: 1 Received: 2, URL: <http://d-transformer:9090/customTransform>
backend_1        | 2022-02-12T15:35:54.550Z	ERROR	goroutine 236 [running]:
backend_1        | <http://github.com/rudderlabs/rudder-server/utils/logger.(*LoggerT).Fatal(0xc000171600|github.com/rudderlabs/rudder-server/utils/logger.(*LoggerT).Fatal(0xc000171600>, 0xc0005c2fe0, 0x1, 0x1)
backend_1        | 	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/utils/logger/logger.go:265 +0x10b
backend_1        | <http://github.com/rudderlabs/rudder-server/rruntime.Go.func1.1(0x1c19aa0|github.com/rudderlabs/rudder-server/rruntime.Go.func1.1(0x1c19aa0>, 0xc000094360)
backend_1        | 	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:42 +0x37f
backend_1        | panic(0x15913c0, 0xc0005c2c90)
backend_1        | 	/root/.goenv/versions/1.13.8/src/runtime/panic.go:679 +0x1b2
backend_1        | <http://github.com/rudderlabs/rudder-server/processor/transformer.(*HandleT).transformWorker(0xc000228000)|github.com/rudderlabs/rudder-server/processor/transformer.(*HandleT).transformWorker(0xc000228000)>
backend_1        | 	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/processor/transformer/transformer.go:159 +0xe11
backend_1        | <http://github.com/rudderlabs/rudder-server/processor/transformer.(*HandleT).Setup.func1()|github.com/rudderlabs/rudder-server/processor/transformer.(*HandleT).Setup.func1()>
backend_1        | 	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/processor/transformer/transformer.go:213 +0x2a
backend_1        | <http://github.com/rudderlabs/rudder-server/rruntime.Go.func1(0xc0006645a0)|github.com/rudderlabs/rudder-server/rruntime.Go.func1(0xc0006645a0)>
backend_1        | 	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:46 +0x81
backend_1        | created by <http://github.com/rudderlabs/rudder-server/rruntime.Go|github.com/rudderlabs/rudder-server/rruntime.Go>
backend_1        | 	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:32 +0x3f
backend_1        |
backend_1        | 2022/02/12 15:35:54 notifying bugsnag: Incompatible transformer version: Expected: 1 Received: 2, URL: <http://d-transformer:9090/customTransform>
backend_1        | 2022/02/12 15:35:54 bugsnag.Notify: bugsnag/payload.deliver: invalid api key: ''
backend_1        | 2022/02/12 15:35:54 bugsnag/sessions/publisher.publish invalid API key: ''
backend_1        | panic: Incompatible transformer version: Expected: 1 Received: 2, URL: <http://d-transformer:9090/customTransform> [recovered]
backend_1        | 	panic: Incompatible transformer version: Expected: 1 Received: 2, URL: <http://d-transformer:9090/customTransform> [recovered]
backend_1        | 	panic: Incompatible transformer version: Expected: 1 Recei

Any help?

tall-table-22243

02/12/2022, 10:25 PM

Question about the Java client. Currently we're using the Java SDK as documented: https://www.rudderstack.com/docs/stream-sources/rudderstack-sdk-integration-guides/rudderstack-java-sdk/

Copy code

<dependency>
   <groupId>com.rudderstack.sdk.java</groupId>
     <artifactId>rudderanalytics-client</artifactId>
   <version>1.0.1</version>
</dependency>

a. this version shows a dependency on a dom4j version (1.6.1) that has a serious CVSS score

Copy code

[INFO] +- com.rudderstack.sdk.java:rudderanalytics-client:jar:1.0.1:compile
[INFO] |  +- com.squareup.retrofit:retrofit:jar:1.9.0:compile
[INFO] |  +- com.google.auto.value:auto-value-annotations:jar:1.6:compile
[INFO] |  +- com.google.code.findbugs:findbugs:jar:3.0.1:compile
[INFO] |  |  +- net.jcip:jcip-annotations:jar:1.0:compile
[INFO] |  |  +- com.google.code.findbugs:bcel-findbugs:jar:6.0:compile
[INFO] |  |  +- com.google.code.findbugs:jFormatString:jar:2.0.1:compile
[INFO] |  |  +- dom4j:dom4j:jar:1.6.1:compile

b. findbugs is a reporting tool and therefore shouldn't be included as a dependency in the pom.xml. In fact when I deleted this dependency, the compile proceeded just fine. If findbugs were removed, the vulnerability finding would be fixed. c. the latest version of the Rudder java sdk repo doesn't build

rudderanalytics-client

so I'm unable to submit a pull request to fix this issue. Is there a new SDK library? Is the documentation available? Does it not have the

findbugs

as a compile dependency anymore?

🎫 1

gifted-ice-67041

02/14/2022, 8:00 AM

Profitwell isn't receiving identify events. I tried to checkout the destination using

<https://api.rudderstack.com/v0/testDestination/><id>

, but it's returning

error: "Not Found"

🎫 1

some-hairdresser-19638

02/14/2022, 10:13 AM

can i add source and destination through api?

bright-room-97374

02/14/2022, 2:40 PM

how do I see why an event failed to deliver?

chilly-vase-86922

02/14/2022, 5:44 PM

Hey folks. I seem to have an issue with routing — three Segment sources (for Android, iOS, backend) are connected to an Amplitude destination, which has a simple transformation. While I can see live events arriving from all three Segment sources, and those events are successfully routed to other destinations, events from only two of the three sources arrive at the Amplitude transform (Android events are missing). Indeed, from looking at the transformer DEBUG logs, I don’t see any Segment-Android events being processed for the Amplitude destination. I've tried deleting and recreating the destination, and connecting/reconnecting the sources to the destination. What would be the best way to debug this further, or any ideas on how to resolve this? :)

swift-doctor-91289

02/14/2022, 10:59 PM

Hi, I am new to RudderStack and encountered the error

Failed to create role resources

while adding a salesforce source. I am currently stuck on this page. Any idea?

gray-controller-34084

02/14/2022, 11:27 PM

Hi, did anyone use Rudderstack open-source the entire stack in Google Cloud? We are going through evaluation process. I did it for Snowplow open source. Now it's turn for RudderStack. I don't see any documentation around cloud platform installation like Snowplow open source

eager-continent-55572

02/15/2022, 11:30 AM

👋 Hello, team!

Copy code

I am trying to create destination via TF for "ActiveCampaign" but getting error
 "Could not create destination, unexpected error: status: 400, body: {"error":"could not find destination definition for type 'ActiveCampaign"

Can anyone suggest exact name to be used for "ActiveCampaign" as destination?

│ Campaign"

eager-continent-55572

02/15/2022, 2:28 PM

Copy code

Does anyone has implemented CI/CD in gitlab or any other for "rudderstack" to deploy unpublished "transformation"?

steep-state-59062

02/15/2022, 3:38 PM

Hi, We are trying to use the rudderstack web console to set up source to destination syncs between Snowflake (source) to Iterable (destination). I have the source to destination sync configured but was only able to see User as the destination object. I am trying to sync some user attributes and event attributes as a test case. The documentation does not go into the details of the mapping for each use case. I would appreciate some inputs. Thank you!

🎫 1

steep-state-59062

02/15/2022, 4:19 PM

it appears this interface syncs events only. Is that correct?

dry-house-78213

02/15/2022, 10:00 PM

Hey folks, Am I right in saying that the CloudExtract integration with Active Campaign doesn't include custom fields? Can't see them in the organization or contacts resource but might be missing something!

🎫 1

thankful-breakfast-35449

02/15/2022, 10:41 PM

Hello, this may seem a bit strange, but is it possible in a transformation to turn the event being transformed into two events?

melodic-nightfall-16182

02/16/2022, 3:51 AM

hi, I am an admin but I couldn’t find where I should edit the billing payment info. I used to be able to. Somehow I couldn’t find it anymore

nice-forest-92820

02/16/2022, 7:42 AM

Hi there! I need to connect 2 sources to my PHP source: Amplitude and Google Analytics 4. For some reason I can't add Google Analytics 4 as a second destination to my PHP source. Only if I create a new PHP source ("test php") then I can add both. Is this a bug?

some-hairdresser-19638

02/16/2022, 8:21 AM

#support i want to retarget on Facebook using the data collected from rudderstack. How can i do that?

🎫 1

rapid-machine-50930

02/16/2022, 10:39 AM

Hi there, with Rudderstack is it possible to store my configurations in the interface as a file and manage them via git versioning?

nice-forest-92820

02/16/2022, 11:54 AM

Quick question: does RudderStack make the page() call automatically on all pages, or do I need to call it manually?

mammoth-kitchen-41836

02/16/2022, 12:33 PM

Hello Team, we are getting lot of this errors in rudderstack “Failed to remove staging file: remove /data/rudderstack/rudder-warehouse-json-uploads-tmp/BQ_1rHZd7UgAdLz86JttKDeD5T7ZPi/rudder/rudder-warehouse-staging-logs/1pqFyBGQfFDje9hQLuHk1K4oR7I/02-16-2022/1645006199.1pqFyBGQfFDje9hQLuHk1K4oR7I.8102bee5-ea0e-4c0f-be65-46677666b861.json.gz: no such file or directory”

🎫 1

mammoth-kitchen-41836

02/16/2022, 12:33 PM

Could someone please help?

gray-controller-34084

02/17/2022, 4:19 AM

What's the difference between Rudderstack open source vs pro?

high-fall-35889

02/17/2022, 6:40 AM

Hi, We are using RudderStack React Native, and CleverTap as a destination, on IOS everything works fine and the data is logged to CleverTap, on Android nothing is logged, we are getting in logcat

Copy code

E/RudderSDK: Error: Invalid CleverTap Account Credentials, Aborting

I've checked the credentials multiple time and they are correct, what could be the cause of this please?

🎫 1

loud-fish-40247

02/17/2022, 9:48 AM

Hi, need some help with SendGrid integration as a source. Is there any option to sync all the activity data i.e. mails sent and their subjects to redshift as a destination not only statistics?

eager-continent-55572

02/17/2022, 11:15 AM

Hi, I am trying to set

apiKey

and

eventKey

for

Active_Campaign

actid

as destination objects via terraform but getting error. Is there no support to set secrete object via terraform code? When I pass these object as empty string then configuration get applied via TF code but incase if am passing any value inside these objects then TF throws given error.

Copy code

resource "rudderstack_destination" "ac_dst1" {
  name = "ac_sandbox"
  type = "ACTIVE_CAMPAIGN"
  config = {
    object = {
      "apiUrl" : { str = "<https://test-env.com>" },
      "actid" : { str = "" },
      "apiKey" : { str = "1234567" },
      "eventKey" : { str = "1234567" }
    }
  }
}

Error:

When applying changes to <http://rudderstack_destination.ac|rudderstack_destination.ac>_dst1, provider "provider[\"<http://registry.terraform.io/rudderlabs/rudderstack|registry.terraform.io/rudderlabs/rudderstack>\"]"

│ produced an unexpected new value: .config.object: element "apiKey" has vanished.

│

│ This is a bug in the provider, which should be reported in the provider's own issue tracker.

╵

╷

│ Error: Provider produced inconsistent result after apply

│

│ When applying changes to <http://rudderstack_destination.ac|rudderstack_destination.ac>_dst1, provider "provider[\"<http://registry.terraform.io/rudderlabs/rudderstack|registry.terraform.io/rudderlabs/rudderstack>\"]"

│ produced an unexpected new value: .config.object: element "eventKey" has vanished.

│

│ This is a bug in the provider, which should be reported in the provider's own issue tracker.

╵

🎫 1

proud-ice-22259

02/17/2022, 3:52 PM

Hey guys, Had a query. While using the page view API in javascript SDK. the

title

property inside properties returns an empty string for the pages where I’ve explicitly defined the title using the head component defined in Next.JS

<_Head_>

{title _&&_ <_title_>{title}</_title_>}

{content _&&_ <_meta_

_name=_"description" _content=_{content} />}

</_Head_>

Am I missing something?

thankful-breakfast-35449

02/17/2022, 3:53 PM

Does the latest Ruby SDK gem

rudder_analytics_sync

support Ruby 3.0?

steep-gold-12616

02/17/2022, 6:10 PM

Hi! -- New to rudderstack and getting our proof-of-concept stood up. I've got a field for which I have changed the data type (was boolean, now is a string). Per the documentation, those events with strings are now coming through to my RUDDER_DISCARDS table. If I want to permanently change this data type, can I just drop the table in my destination (snowflake) and rudderstack will re-create it with the appropriate new data type?