solved it! seems like its the canonical url that was causing issues

Hey Guys, QQ : We are getting this error quite often in our rudder amplitude pipeline :

userId xxx failed for the first time adding to map

What I understood from the code was that this is happening because of

guaranteeUserEventOrder

flag set to true. Can u please help us understand this particular property more and how can we avoid the failure of events?

follow up question i asked on discord: hey all, quick question about how posthog works with rudderstack. At https://posthog.com/docs/integrations/rudderstack-integration it mentions that rudderstack doesn't not support autocapture. Does that differ from the autotracking functionaltiy that rudderstack provides with their sdk?

Hello, is there any way to get log of the destination’s webhooks result?

Hi Team, I just joined Rudderstack slack channel. We are using rudderstack from a year. We plan to upgrade to the latest version released on dockerhub and I am getting this error • Earlier version we were using : rudderlabs/rudder-server:17122020.184340 • New version tried to upgrade: rudderlabs/rudder-server:23032021.061242 I getting this following error ... does anyone has suggestion how can we fix this.

2021-03-26T14:10:29.893+1100	INFO	WH: Starting Warehouse service...
2021-03-26T14:10:29.924+1100	ERROR	Could not run warehouse database migrations: Could not run migration from directory 'warehouse', Dirty database version 8. Fix and force version.
2021-03-26T14:10:29.924+1100	ERROR	goroutine 39 [running]:
<http://github.com/rudderlabs/rudder-server/utils/logger.(*LoggerT).Fatal(0xc0001d5860|github.com/rudderlabs/rudder-server/utils/logger.(*LoggerT).Fatal(0xc0001d5860>, 0xc00087a3d0, 0x1, 0x1)
	/codebuild/output/src284385697/src/github.com/rudderlabs/rudder-server/utils/logger/logger.go:264 +0x10b
<http://github.com/rudderlabs/rudder-server/rruntime.Go.func1.1(0x1e73b20|github.com/rudderlabs/rudder-server/rruntime.Go.func1.1(0x1e73b20>, 0xc0005ce6c0)
	/codebuild/output/src284385697/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:42 +0x37f
panic(0x1748060, 0xc0002cafc0)
	/root/.goenv/versions/1.13.8/src/runtime/panic.go:679 +0x1b2
<http://github.com/rudderlabs/rudder-server/warehouse.setupTables(0xc00025a240)|github.com/rudderlabs/rudder-server/warehouse.setupTables(0xc00025a240)>
	/codebuild/output/src284385697/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:857 +0x127
<http://github.com/rudderlabs/rudder-server/warehouse.setupDB(0xc0007e42a0|github.com/rudderlabs/rudder-server/warehouse.setupDB(0xc0007e42a0>, 0x67)
	/codebuild/output/src284385697/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:1010 +0xf7
<http://github.com/rudderlabs/rudder-server/warehouse.Start()|github.com/rudderlabs/rudder-server/warehouse.Start()>
	/codebuild/output/src284385697/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:1024 +0xcc
main.startWarehouseService(...)
	/codebuild/output/src284385697/src/github.com/rudderlabs/rudder-server/main.go:74
main.main.func5()
	/codebuild/output/src284385697/src/github.com/rudderlabs/rudder-server/main.go:169 +0x21
<http://github.com/rudderlabs/rudder-server/rruntime.Go.func1(0x1a95608)|github.com/rudderlabs/rudder-server/rruntime.Go.func1(0x1a95608)>
	/codebuild/output/src284385697/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:46 +0x81
created by <http://github.com/rudderlabs/rudder-server/rruntime.Go|github.com/rudderlabs/rudder-server/rruntime.Go>
	/codebuild/output/src284385697/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:32 +0x3f

2021/03/26 14:10:29 notifying bugsnag: Could not run warehouse database migrations: Could not run migration from directory 'warehouse', Dirty database version 8. Fix and force version.
2021/03/26 14:10:29 bugsnag.Notify: bugsnag/payload.deliver: invalid api key: ''
2021/03/26 14:10:29 bugsnag/sessions/publisher.publish invalid API key: ''

Hi team! Who should I talk to for white label / reselling plans?

Hi All... I'm running Rudderstack with Kubernetes, i'm seeing this error on

analytics-rudderstack-0

, Which is causing it to restart lots (47 times in the last 8 hours!) Is there anything i'm missing?

2021/03/27 19:02:03 notifying bugsnag: json: error calling MarshalJSON for type json.RawMessage: invalid character 'p' after object key:value pair
panic: json: error calling MarshalJSON for type json.RawMessage: invalid character 'p' after object key:value pair [recovered]
	panic: json: error calling MarshalJSON for type json.RawMessage: invalid character 'p' after object key:value pair [recovered]
	panic: json: error calling MarshalJSON for type json.RawMessage: invalid character 'p' after object key:value pair
goroutine 107 [running]:
<http://github.com/bugsnag/bugsnag-go.AutoNotify(0xc000939ca0|github.com/bugsnag/bugsnag-go.AutoNotify(0xc000939ca0>, 0x3, 0x3)
	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/vendor/github.com/bugsnag/bugsnag-go/bugsnag.go:109 +0x2bc
panic(0x15c8740, 0xc00023f3a0)
	/root/.goenv/versions/1.13.8/src/runtime/panic.go:679 +0x1b2
<http://github.com/rudderlabs/rudder-server/rruntime.Go.func1.1|github.com/rudderlabs/rudder-server/rruntime.Go.func1.1>(0x1c19aa0, 0xc0002d8120)
	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:43 +0x39a
panic(0x15c8740, 0xc00023f3a0)
	/root/.goenv/versions/1.13.8/src/runtime/panic.go:679 +0x1b2
<http://github.com/rudderlabs/rudder-server/utils/misc.AssertErrorIfDev|github.com/rudderlabs/rudder-server/utils/misc.AssertErrorIfDev>(0x1bee7c0, 0xc00023f3a0)
	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/utils/misc/misc.go:157 +0x14a
<http://github.com/rudderlabs/rudder-server/services/destination-debugger.uploadJobs(0xc000eb4020|github.com/rudderlabs/rudder-server/services/destination-debugger.uploadJobs(0xc000eb4020>, 0x1, 0x1)
	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/services/destination-debugger/eventDeliveryStatusUploader.go:120 +0x85d
<http://github.com/rudderlabs/rudder-server/services/destination-debugger.flushJobs()|github.com/rudderlabs/rudder-server/services/destination-debugger.flushJobs()>
	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/services/destination-debugger/eventDeliveryStatusUploader.go:202 +0x134
<http://github.com/rudderlabs/rudder-server/services/destination-debugger.Setup.func3()|github.com/rudderlabs/rudder-server/services/destination-debugger.Setup.func3()>
	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/services/destination-debugger/eventDeliveryStatusUploader.go:99 +0x20
<http://github.com/rudderlabs/rudder-server/rruntime.Go.func1(0x18dac98)|github.com/rudderlabs/rudder-server/rruntime.Go.func1(0x18dac98)>
	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:46 +0x81
created by <http://github.com/rudderlabs/rudder-server/rruntime.Go|github.com/rudderlabs/rudder-server/rruntime.Go>
	/codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:32 +0x3f

Can anyone help out with this one? Why am I getting the following error even when the payload is correct for the

putEvents

API?

{
    "response": "Could not unmarshal jsonData according to putEvents input structure",
    "firstAttemptedAt": "2021-03-27T20:37:03.844Z"
}
// Payload:
{
    "eventList": [
        {
            "itemId": "20515",
            "sentAt": "2021-03-27T20:36:48.793Z",
            "eventType": "click",
            "timestamp": 1616877409,
            "impression": "",
            "properties": {
                "filters": ""
            }
        }
    ],
    "sessionId": "910290eb-2438-4392-98f2-7223b0708de3",
    "trackingId": "d95a802a-c299-49ca-8a21-16d09e91b8a5",
    "userId": "abc123"
}

It has all the required fields according to the docs: https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/personalize-events.html#PersonalizeEvents.Client.put_events

Hey 👋 Is carthage supported? How can i use it for installing the iOS SDK? If it’s not, could it be supported? Thanks for your answers 🙏

Is it possible to have code re-use across many User Transformations, other than by calling an external API? In https://docs.rudderstack.com/adding-a-new-user-transformation-in-rudderstack it shows you can declare and call functions in the transformer, but could we re-use a function using node.js

require

or similar? I am thinking of use cases such as removing PII by using the same logic for multiple destinations, and re-using enrichment functions. I know we could call an API but would rather keep most of our customer data logic within rudder, and only rely on APIs when 3rd party products are needed.

https://github.com/rudderlabs/rudder-sdk-node/pulls seems outdated and has a few libraries to upgrade. Specially this one https://github.com/rudderlabs/rudder-sdk-node/pull/7 resolves a high security vulnerability.

Hello, quick question about event type track.Integrations values, just to confirm it is the destination name right? is it case sensitive?

Hi - having issues with minio and yandex object storage (which is minio/s3 compat) - is there any reason the minio-go package used in rudder is v6 and not v7?

Hi - Getting following error on rudderstack: 2021/04/01 044614 bugsnag/sessions/publisher.publish unable to deliver session: Post https://sessions.bugsnag.com: dial tcp 35.190.88.7443 i/o timeout panic: json: cannot unmarshal array into Go struct field TransformerResponseT.output of type map[string]interface {} [recovered] panic: json: cannot unmarshal array into Go struct field TransformerResponseT.output of type map[string]interface {} [recovered] panic: json: cannot unmarshal array into Go struct field TransformerResponseT.output of type map[string]interface {} goroutine 215 [running]: github.com/bugsnag/bugsnag-go.AutoNotify(0xc0013b3978, 0x3, 0x3) /codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/vendor/github.com/bugsnag/bugsnag-go/bugsnag.go:109 +0x2bc panic(0x1590b80, 0xc00008b450) /root/.goenv/versions/1.13.8/src/runtime/panic.go:679 +0x1b2 github.com/rudderlabs/rudder-server/rruntime.Go.func1.1(0x1c19aa0, 0xc000179e90) /codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:43 +0x39a panic(0x1590b80, 0xc00008b450) /root/.goenv/versions/1.13.8/src/runtime/panic.go:679 +0x1b2 github.com/rudderlabs/rudder-server/processor/transformer.(*HandleT).transformWorker(0xc0001ce000) /codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/processor/transformer/transformer.go:185 +0xdf5 github.com/rudderlabs/rudder-server/processor/transformer.(*HandleT).Setup.func1() /codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/processor/transformer/transformer.go:213 +0x2a github.com/rudderlabs/rudder-server/rruntime.Go.func1(0xc000165470) /codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:46 +0x81 created by github.com/rudderlabs/rudder-server/rruntime.Go /codebuild/output/src427158458/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:32 +0x3f

Hi Guys! How are you? I'm evaluating RudderStack (currently at free cloud version), and I found some questions: • I'm always using RudderStack HTTP API as the source. • I'm sending events to Amplitude, Mixpanel, Posthog, and Analytics. • I'm not using transformations. Questions: 1. I'm getting several "error 500" when sending events from our server to Rudderstack. Could the 500 events/hour free version limit cause it? 2. I'm well-receiving events on Amplitude (apparently). Mixpanel shows around 15-20% fewer events. For the same period and event, MixPanel shows around 15-20% fewer unique events. What could be the cause, or how can I troubleshoot it? 3. Same source. Posthog show event names but not hits. Posthog shows many anonymous personas, but we aren't sending anonymous events (all events have user_id attached). 4. Do the Rudderstack javascript client library events compute for the 500 events/hour limit? Thanks!

Good morning ! We are currently comparing Enterprise and open source versions and there is one question we couldn’t find an answer to in the docs. Is there a “time to live” for each event ? For example, let’s say a destination is unavailable for a full week, will the events stay in the postgrees “queue” for that destination forever, or will they be deleted after some time ? And if there is a “time to live” config, where is it in the server config ? Thanks !

Hello - we ran into an interesting issue, maybe it’s useful for others… we are using Leanplum for notifications and have noticed that no customer on iOS has a push notification token. After much debugging and tracing I found that the Leanplum SDK is getting the device ID (IDFV) by itself and is sending it to the Leanplum server. The events we send through Rudderstack have the same ID, but all lowercase. (IDVF is all uppercase by default.) As Leanplum uses this device ID to identify users, this resulted in having duplicated users - the uppercase one had the push token, while the lowercase one had everything else (attributes, events, whatnot). I found that the iOS Rudderstack SDK converts the DeviceID to lowercase: https://github.com/rudderlabs/rudder-sdk-ios/blob/09d5e74ba461c8b33874fb1a99a05c95004aacf2/Rudder/Classes/RSDeviceInfo.m#L18 Is this intentional or did I found a case that can cause issues with some destinations? (Running RudderStack open source on premises)

That's interesting. We had lower-cased it for some other destination. @adamant-airplane-7907 can you take a look?

is there currently support for facebook's conversions API / server-to-server events?

Hi guys! My rudderstack instance went from using 250mb of memory to over 8gb of memory now overnight. The only error I see in the logs is related to the archiver. I searched through this channel and noticed @narrow-rain-89253 mention it should not affect operations. Any thoughts on what else might be causing rudderstack to use so much memory?

Hello everybody. I would like to report a problem. what happened I am trying to use rudderstack-sdk-js in a website but I am running into a CORS problem. I set everything up as the documatation says (https://github.com/rudderlabs/rudder-analytics-react/tree/master/SampleReactAppUsingNPM/src) and I get something like this in the chrome console:

Access to XMLHttpRequest at '<https://jetstackjulmm.dataplane.rudderstack.com/v1/page>' from origin '<http://localhost:3000>' has been blocked by CORS policy: Response to preflight request doesn't pass access control check: No 'Access-Control-Allow-Origin' header is present on the requested resource.

In the network tab I see how the CORS preflight request fails with 404. I could reproduce that with curl as well:

$ curl '<https://jetstackjulmm.dataplane.rudderstack.com/v1/page>' \
  -X 'OPTIONS' \
  -H 'authority: <http://jetstackjulmm.dataplane.rudderstack.com|jetstackjulmm.dataplane.rudderstack.com>' \
  -H 'accept: */*' \
  -H 'access-control-request-method: POST' \
  -H 'access-control-request-headers: anonymousid,authorization,content-type' \
  -H 'origin: <http://localhost:3000>' \
  -H 'user-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.90 Safari/537.36' \
  -H 'sec-fetch-mode: cors' \
  -H 'sec-fetch-site: cross-site' \
  -H 'sec-fetch-dest: empty' \
  -H 'referer: <http://localhost:3000/>' \
  -H 'accept-language: en-US,en;q=0.9,es;q=0.8' \
  --compressed -v
*   Trying 34.235.1.91:443...
* TCP_NODELAY set
* Connected to <http://jetstackjulmm.dataplane.rudderstack.com|jetstackjulmm.dataplane.rudderstack.com> (34.235.1.91) port 443 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* successfully set certificate verify locations:
*   CAfile: /etc/ssl/certs/ca-certificates.crt
  CApath: /etc/ssl/certs
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.2 (IN), TLS handshake, Certificate (11):
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
* TLSv1.2 (IN), TLS handshake, Server finished (14):
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
* TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):
* TLSv1.2 (OUT), TLS handshake, Finished (20):
* TLSv1.2 (IN), TLS handshake, Finished (20):
* SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
* ALPN, server accepted to use h2
* Server certificate:
*  subject: CN=*.<http://dataplane.rudderstack.com|dataplane.rudderstack.com>
*  start date: Feb 11 00:00:00 2021 GMT
*  expire date: Mar 12 23:59:59 2022 GMT
*  subjectAltName: host "<http://jetstackjulmm.dataplane.rudderstack.com|jetstackjulmm.dataplane.rudderstack.com>" matched cert's "*.<http://dataplane.rudderstack.com|dataplane.rudderstack.com>"
*  issuer: C=US; O=Amazon; OU=Server CA 1B; CN=Amazon
*  SSL certificate verify ok.
* Using HTTP2, server supports multi-use
* Connection state changed (HTTP/2 confirmed)
* Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0
* Using Stream ID: 1 (easy handle 0x5608fac03e10)
> OPTIONS /v1/page HTTP/2
> Host: <http://jetstackjulmm.dataplane.rudderstack.com|jetstackjulmm.dataplane.rudderstack.com>
> accept-encoding: deflate, gzip, br
> authority: <http://jetstackjulmm.dataplane.rudderstack.com|jetstackjulmm.dataplane.rudderstack.com>
> accept: */*
> access-control-request-method: POST
> access-control-request-headers: anonymousid,authorization,content-type
> origin: <http://localhost:3000>
> user-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.90 Safari/537.36
> sec-fetch-mode: cors
> sec-fetch-site: cross-site
> sec-fetch-dest: empty
> referer: <http://localhost:3000/>
> accept-language: en-US,en;q=0.9,es;q=0.8
> 
* Connection state changed (MAX_CONCURRENT_STREAMS == 128)!
< HTTP/2 404 
< server: awselb/2.0
< date: Thu, 08 Apr 2021 15:38:22 GMT
< content-type: text/plain; charset=utf-8
< content-length: 0
< 
* Connection #0 to host <http://jetstackjulmm.dataplane.rudderstack.com|jetstackjulmm.dataplane.rudderstack.com> left intact

You need to serve access control headers on your page

Hey @adamant-airplane-7907 @glamorous-mouse-54282 🙂 Any news about Carthage support? Thanks!

@adventurous-cat-93802 We’re working on this in this sprint. It’s expected to be released by next week

Could any one tell why below error comes "Access to XMLHttpRequest at 'https://rudderstack-stage.ex.com:8085/v1/track' from origin 'https://local.ex.com' has been blocked by CORS policy: Response to preflight request doesn't pass access control check: It does not have HTTP ok status."

Hi team. When using Google Analytics as a destination with the "Server Side Identify" turned off, I see the following error in the transformer. I wonder if that can impact the app in some way? Or is it safe as it is? I tried filtering the identifies using a transformer but that doesn't do it. (Guessing this runs before the transformer)

Hi, is anyone else using the Amplitude connector? Our instance has stopped sending data, and i can't diagnose why... other destinations work ok, but Amplitude never has anything in Live Events anymore. It's been this way for > 7days now. I've tried deleting the destination & starting from scratch, but no luck. Something i've noticed is that when changing the destination settings, it never seems to 'remember' the API key... is that common?