RudderStack #support

rough-alligator-32210

09/17/2021, 10:04 AM

Hey guys, we’re having issues with a memory leak in rudder-server (again) • 4 GB memory / 1vCPU (AWS Fargate) • We’re using

rudderlabs/rudder-server:1-alpine

Docker image • Destinations used ◦ FB Pixel ◦ Heap ◦ Hotjar ◦ BigQuery ◦ customer.io • one quirky setup we have is

<http://customer.io|customer.io> (source) --> <http://customer.io|customer.io> (destination)

• “sessions” are disabled (or better said, they’re left to their default settings) Also, please find below the output of

go tool pprof -top ./rudder-server heap.out

Copy code

File: rudder-server
Type: inuse_space
Showing nodes accounting for 55.86MB, 100% of 55.86MB total
      flat  flat%   sum%        cum   cum%
      32MB 57.28% 57.28%       32MB 57.28%  <http://github.com/pierrec/lz4.(*Writer).writeHeader|github.com/pierrec/lz4.(*Writer).writeHeader>
   11.96MB 21.40% 78.69%    14.72MB 26.35%  [rudder-server]
    3.54MB  6.34% 85.03%    55.86MB   100%  syscall.sendmsg
    1.76MB  3.16% 88.18%     1.76MB  3.16%  <http://golang.org/x/text/unicode/norm.(*reorderBuffer).compose|golang.org/x/text/unicode/norm.(*reorderBuffer).compose>
    1.58MB  2.83% 91.02%     1.58MB  2.83%  <http://gopkg.in/yaml%2ev2.yaml_emitter_emit_scalar|gopkg.in/yaml%2ev2.yaml_emitter_emit_scalar>
       1MB  1.79% 92.81%        1MB  1.79%  reflect.cvtInt
    0.52MB  0.92% 93.73%     0.52MB  0.92%  <http://github.com/lib/pq.userCurrent|github.com/lib/pq.userCurrent>
    0.50MB   0.9% 94.63%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/sts.(*AssumeRoleWithWebIdentityOutput).String|github.com/aws/aws-sdk-go/service/sts.(*AssumeRoleWithWebIdentityOutput).String>
    0.50MB   0.9% 95.52%     0.50MB   0.9%  regexp/syntax.(*parser).parseEscape
    0.50MB   0.9% 96.42%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/s3.(*ErrorDocument).Validate|github.com/aws/aws-sdk-go/service/s3.(*ErrorDocument).Validate>
    0.50MB   0.9% 97.31%     0.50MB   0.9%  net.(*byRFC6724).Swap
    0.50MB   0.9% 98.21%     0.50MB   0.9%  <http://github.com/mitchellh/mapstructure.(*Decoder).decodeMapFromSlice|github.com/mitchellh/mapstructure.(*Decoder).decodeMapFromSlice>
    0.50MB   0.9% 99.10%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/firehose.(*ExtendedS3DestinationUpdate).SetBucketARN|github.com/aws/aws-sdk-go/service/firehose.(*ExtendedS3DestinationUpdate).SetBucketARN>
    0.50MB   0.9%   100%     0.50MB   0.9%  <http://github.com/mitchellh/mapstructure.(*Decoder).decodeMapFromStruct|github.com/mitchellh/mapstructure.(*Decoder).decodeMapFromStruct>
         0     0%   100%     2.26MB  4.05%  crypto/tls.(*clientHandshakeStateTLS13).processHelloRetryRequest
         0     0%   100%     1.76MB  3.16%  crypto/tls.(*clientHandshakeStateTLS13).processServerHello
         0     0%   100%        1MB  1.79%  database/sql.(*DB).putConn
         0     0%   100%        1MB  1.79%  database/sql.(*DB).queryDC
         0     0%   100%     0.50MB   0.9%  encoding/gob.isZero
         0     0%   100%       32MB 57.28%  <http://github.com/Shopify/sarama.(*AddPartitionsToTxnResponse).requiredVersion|github.com/Shopify/sarama.(*AddPartitionsToTxnResponse).requiredVersion>
         0     0%   100%     1.02MB  1.82%  <http://github.com/Shopify/sarama.(*ApiVersionsResponse).encode|github.com/Shopify/sarama.(*ApiVersionsResponse).encode>
         0     0%   100%     1.02MB  1.82%  <http://github.com/Shopify/sarama.newTransactionManager|github.com/Shopify/sarama.newTransactionManager>
         0     0%   100%     0.52MB  0.92%  <http://github.com/araddon/dateparse.parseTime|github.com/araddon/dateparse.parseTime>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/private/protocol/xml/xmlutil.XMLToStruct|github.com/aws/aws-sdk-go/private/protocol/xml/xmlutil.XMLToStruct>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/firehose.(*ExtendedS3DestinationConfiguration).Validate|github.com/aws/aws-sdk-go/service/firehose.(*ExtendedS3DestinationConfiguration).Validate>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/firehose.(*ExtendedS3DestinationDescription).SetCompressionFormat|github.com/aws/aws-sdk-go/service/firehose.(*ExtendedS3DestinationDescription).SetCompressionFormat>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/firehose.(*ExtendedS3DestinationUpdate).Validate|github.com/aws/aws-sdk-go/service/firehose.(*ExtendedS3DestinationUpdate).Validate>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/firehose.(*RedshiftDestinationConfiguration).Validate|github.com/aws/aws-sdk-go/service/firehose.(*RedshiftDestinationConfiguration).Validate>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/firehose.EncryptionConfiguration.String|github.com/aws/aws-sdk-go/service/firehose.EncryptionConfiguration.String>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/firehose.ExtendedS3DestinationUpdate.GoString|github.com/aws/aws-sdk-go/service/firehose.ExtendedS3DestinationUpdate.GoString>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/firehose.HttpEndpointRetryOptions.String|github.com/aws/aws-sdk-go/service/firehose.HttpEndpointRetryOptions.String>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/s3.(*GetBucketAccelerateConfigurationInput).Validate|github.com/aws/aws-sdk-go/service/s3.(*GetBucketAccelerateConfigurationInput).Validate>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/s3.(*GetBucketAnalyticsConfigurationInput).Validate|github.com/aws/aws-sdk-go/service/s3.(*GetBucketAnalyticsConfigurationInput).Validate>
         0     0%   100%     1.76MB  3.16%  <http://github.com/aws/aws-sdk-go/service/s3.(*GetBucketPolicyStatusInput).Validate|github.com/aws/aws-sdk-go/service/s3.(*GetBucketPolicyStatusInput).Validate>
         0     0%   100%        1MB  1.79%  <http://github.com/aws/aws-sdk-go/service/s3.(*GetObjectAclOutput).SetRequestCharged|github.com/aws/aws-sdk-go/service/s3.(*GetObjectAclOutput).SetRequestCharged>
         0     0%   100%     3.27MB  5.85%  <http://github.com/aws/aws-sdk-go/service/s3.GetObjectInput.String|github.com/aws/aws-sdk-go/service/s3.GetObjectInput.String>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/sso.(*InvalidRequestException).Error|github.com/aws/aws-sdk-go/service/sso.(*InvalidRequestException).Error>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/sso.(*LogoutInput).Validate|github.com/aws/aws-sdk-go/service/sso.(*LogoutInput).Validate>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/sso.LogoutInput.GoString|github.com/aws/aws-sdk-go/service/sso.LogoutInput.GoString>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/sts.(*AssumeRoleWithWebIdentityInput).String|github.com/aws/aws-sdk-go/service/sts.(*AssumeRoleWithWebIdentityInput).String>
         0     0%   100%     0.50MB   0.9%  <http://github.com/aws/aws-sdk-go/service/sts.newClient|github.com/aws/aws-sdk-go/service/sts.newClient>
         0     0%   100%     0.50MB   0.9%  <http://github.com/gorilla/mux.(*Router).Host|github.com/gorilla/mux.(*Router).Host>
         0     0%   100%     0.52MB  0.92%  <http://github.com/hashicorp/go-retryablehttp.(*Client).Post|github.com/hashicorp/go-retryablehttp.(*Client).Post>
         0     0%   100%     0.52MB  0.92%  <http://github.com/hashicorp/go-retryablehttp.Request.Cookie|github.com/hashicorp/go-retryablehttp.Request.Cookie>
         0     0%   100%     0.50MB   0.9%  <http://github.com/hashicorp/go-uuid.GenerateUUIDWithReader|github.com/hashicorp/go-uuid.GenerateUUIDWithReader>
         0     0%   100%     1.76MB  3.16%  <http://github.com/hashicorp/hcl/hcl/parser.(*Parser).objectList|github.com/hashicorp/hcl/hcl/parser.(*Parser).objectList>
         0     0%   100%     0.50MB   0.9%  <http://github.com/jcmturner/gofork/encoding/asn1.parseField|github.com/jcmturner/gofork/encoding/asn1.parseField>
         0     0%   100%     0.50MB   0.9%  <http://github.com/jcmturner/gofork/encoding/asn1.parseSequenceOf|github.com/jcmturner/gofork/encoding/asn1.parseSequenceOf>
         0     0%   100%     0.52MB  0.92%  <http://github.com/lib/pq.(*transactionStatus).String|github.com/lib/pq.(*transactionStatus).String>
         0     0%   100%        1MB  1.79%  <http://github.com/mitchellh/mapstructure.(*Decoder).decodeBool|github.com/mitchellh/mapstructure.(*Decoder).decodeBool>
         0     0%   100%        1MB  1.79%  <http://github.com/mitchellh/mapstructure.(*Decoder).decodeFloat|github.com/mitchellh/mapstructure.(*Decoder).decodeFloat>
         0     0%   100%     0.50MB   0.9%  <http://github.com/mitchellh/mapstructure.(*Decoder).decodeMap|github.com/mitchellh/mapstructure.(*Decoder).decodeMap>
         0     0%   100%     0.50MB   0.9%  <http://github.com/mitchellh/mapstructure.(*Decoder).decodeMapFromMap|github.com/mitchellh/mapstructure.(*Decoder).decodeMapFromMap>
         0     0%   100%        1MB  1.79%  <http://github.com/mitchellh/mapstructure.(*Decoder).decodeUint|github.com/mitchellh/mapstructure.(*Decoder).decodeUint>
         0     0%   100%     0.50MB   0.9%  <http://github.com/pelletier/go-toml.(*tomlLexer).lexKey|github.com/pelletier/go-toml.(*tomlLexer).lexKey>
         0     0%   100%     0.50MB   0.9%  <http://github.com/pelletier/go-toml.(*tomlLexer).lexNan|github.com/pelletier/go-toml.(*tomlLexer).lexNan>
         0     0%   100%     0.50MB   0.9%  <http://github.com/pelletier/go-toml.(*tomlLexer).lexStringAsString|github.com/pelletier/go-toml.(*tomlLexer).lexStringAsString>
         0     0%   100%        1MB  1.79%  <http://github.com/pelletier/go-toml.(*tomlParser).parseRvalue|github.com/pelletier/go-toml.(*tomlParser).parseRvalue>
         0     0%   100%       32MB 57.28%  <http://github.com/pierrec/lz4.(*Writer).Write|github.com/pierrec/lz4.(*Writer).Write>
         0     0%   100%     0.52MB  0.92%  <http://github.com/rudderlabs/rudder-server/router/batchrouter.(*HandleT).recordDeliveryStatus|github.com/rudderlabs/rudder-server/router/batchrouter.(*HandleT).recordDeliveryStatus>
         0     0%   100%     0.52MB  0.92%  <http://github.com/rudderlabs/rudder-server/router/batchrouter.(*HandleT).recordUploadStats|github.com/rudderlabs/rudder-server/router/batchrouter.(*HandleT).recordUploadStats>
         0     0%   100%     0.52MB  0.92%  <http://github.com/rudderlabs/rudder-server/router/batchrouter.(*HandleT).setJobStatus|github.com/rudderlabs/rudder-server/router/batchrouter.(*HandleT).setJobStatus>
         0     0%   100%     0.52MB  0.92%  <http://github.com/rudderlabs/rudder-server/router/batchrouter.(*workerT).constructParameterFilters|github.com/rudderlabs/rudder-server/router/batchrouter.(*workerT).constructParameterFilters>
         0     0%   100%     0.52MB  0.92%  <http://github.com/rudderlabs/rudder-server/router/batchrouter.(*workerT).workerProcess|github.com/rudderlabs/rudder-server/router/batchrouter.(*workerT).workerProcess>
         0     0%   100%     0.50MB   0.9%  <http://github.com/rudderlabs/rudder-server/services/streammanager/googlesheets.insertDataToSheet|github.com/rudderlabs/rudder-server/services/streammanager/googlesheets.insertDataToSheet>
         0     0%   100%    33.02MB 59.10%  <http://github.com/xdg/stringprep.init|github.com/xdg/stringprep.init>
         0     0%   100%     0.50MB   0.9%  <http://google.golang.org/api/sheets/v4.(*HistogramChartSpec).UnmarshalJSON|google.golang.org/api/sheets/v4.(*HistogramChartSpec).UnmarshalJSON>
         0     0%   100%     0.50MB   0.9%  <http://google.golang.org/genproto/googleapis/pubsub/v1.subscriberStreamingPullClient.Context|google.golang.org/genproto/googleapis/pubsub/v1.subscriberStreamingPullClient.Context>
         0     0%   100%     0.50MB   0.9%  <http://gopkg.in/jcmturner/gokrb5.v7/asn1tools.AddASNAppTag|gopkg.in/jcmturner/gokrb5.v7/asn1tools.AddASNAppTag>
         0     0%   100%     0.50MB   0.9%  <http://gopkg.in/jcmturner/gokrb5.v7/config.parseDuration|gopkg.in/jcmturner/gokrb5.v7/config.parseDuration>
         0     0%   100%     0.50MB   0.9%  <http://gopkg.in/jcmturner/gokrb5.v7/credentials.(*Credentials).Authorized|gopkg.in/jcmturner/gokrb5.v7/credentials.(*Credentials).Authorized>
         0     0%   100%     0.50MB   0.9%  <http://gopkg.in/jcmturner/rpc.v1/ndr.rawBytesSize|gopkg.in/jcmturner/rpc.v1/ndr.rawBytesSize>
         0     0%   100%     0.50MB   0.9%  <http://gopkg.in/yaml%2ev2.(*decoder).mappingSlice|gopkg.in/yaml%2ev2.(*decoder).mappingSlice>
         0     0%   100%     0.50MB   0.9%  <http://gopkg.in/yaml%2ev2.(*decoder).setMapIndex|gopkg.in/yaml%2ev2.(*decoder).setMapIndex>
         0     0%   100%        1MB  1.79%  <http://gopkg.in/yaml%2ev2.(*encoder).timev|gopkg.in/yaml%2ev2.(*encoder).timev>
         0     0%   100%     0.50MB   0.9%  <http://gopkg.in/yaml%2ev2.resolve.func1|gopkg.in/yaml%2ev2.resolve.func1>
         0     0%   100%     0.50MB   0.9%  <http://gopkg.in/yaml%2ev2.yaml_emitter_analyze_scalar|gopkg.in/yaml%2ev2.yaml_emitter_analyze_scalar>
         0     0%   100%     2.08MB  3.73%  <http://gopkg.in/yaml%2ev2.yaml_emitter_write_double_quoted_scalar|gopkg.in/yaml%2ev2.yaml_emitter_write_double_quoted_scalar>
         0     0%   100%        1MB  1.79%  <http://gopkg.in/yaml%2ev2.yaml_parser_parse_document_start|gopkg.in/yaml%2ev2.yaml_parser_parse_document_start>
         0     0%   100%     0.50MB   0.9%  net.sortByRFC6724withSrcs
         0     0%   100%     0.50MB   0.9%  regexp.(*Regexp).FindAllIndex
         0     0%   100%     0.50MB   0.9%  regexp/syntax.(*compiler).compile
         0     0%   100%     0.50MB   0.9%  regexp/syntax.(*ranges).Less
         0     0%   100%     0.50MB   0.9%  regexp/syntax.Parse
         0     0%   100%     0.50MB   0.9%  regexp/syntax.dumpInst
         0     0%   100%     0.50MB   0.9%  regexp/syntax.escape
         0     0%   100%     0.50MB   0.9%  regexp/syntax.writeRegexp
         0     0%   100%     0.50MB   0.9%  runtime/pprof.(*profileBuilder).build
         0     0%   100%     1.58MB  2.83%  runtime/pprof.(*profileBuilder).pbMapping
         0     0%   100%        1MB  1.79%  time.(*Time).Clock
         0     0%   100%        1MB  1.79%  time.(*Time).Day
         0     0%   100%     0.50MB   0.9%  type..<http://hash.github.com/aws/aws-sdk-go/service/sts.AssumeRoleWithSAMLOutput|hash.github.com/aws/aws-sdk-go/service/sts.AssumeRoleWithSAMLOutput>
         0     0%   100%        1MB  1.79%  type..<http://hash.github.com/pelletier/go-toml.annotation|hash.github.com/pelletier/go-toml.annotation>

Any pointers as to what might be the cause would be greatly appreciated.

powerful-forest-14749

09/17/2021, 12:59 PM

Hi guys, re the AppsFlyer destination (for an iOS React Native project), do you have to follow both of these steps or just the RN (2nd screenshot)? i.e. do we need to edit any objective c code for a React Native integration? Thanks!

clever-helmet-16168

09/17/2021, 3:48 PM

Hi Team, I have a couple of questions: • our integration with salesforce sometimes has errors (duplicate identity, etc.), Is there is a way to view the errors log? and how can we see the full historical log of this errors? • Can we have a notification when an error happen? • Is there a way (dashboard or something) to monitor all the transactions (like number of succeeded and failed events in specific time period)?

rough-alligator-32210

09/20/2021, 8:26 AM

Hey guys, we used to have OutOfMemory issues, and we boiled it down to warehouse syncs running too often. This lead us to only running the syncs at 3m UTC, which causes a CPU run out and it throws a DATA RACE WARNING

rough-alligator-32210

09/20/2021, 8:27 AM

Copy code

==================
WARNING: DATA RACE
Write at 0x00c000ac0a60 by goroutine 135:
<http://github.com/rudderlabs/rudder-server/warehouse.(*HandleT).backendConfigSubscriber()|github.com/rudderlabs/rudder-server/warehouse.(*HandleT).backendConfigSubscriber()>
/codebuild/output/src071433866/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:220 +0x5b1
<http://github.com/rudderlabs/rudder-server/warehouse.(*HandleT).Setup.func1()|github.com/rudderlabs/rudder-server/warehouse.(*HandleT).Setup.func1()>
/codebuild/output/src071433866/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:901 +0x41
<http://github.com/rudderlabs/rudder-server/rruntime.Go.func1()|github.com/rudderlabs/rudder-server/rruntime.Go.func1()>
/codebuild/output/src071433866/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:46 +0x9e
Previous read at 0x00c000ac0a60 by goroutine 714:
<http://github.com/rudderlabs/rudder-server/warehouse.(*HandleT).uploadStatusTrack()|github.com/rudderlabs/rudder-server/warehouse.(*HandleT).uploadStatusTrack()>
/codebuild/output/src071433866/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:804 +0x197
<http://github.com/rudderlabs/rudder-server/warehouse.(*HandleT).monitorUploadStatus.func1()|github.com/rudderlabs/rudder-server/warehouse.(*HandleT).monitorUploadStatus.func1()>
/codebuild/output/src071433866/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:914 +0x41
<http://github.com/rudderlabs/rudder-server/rruntime.Go.func1()|github.com/rudderlabs/rudder-server/rruntime.Go.func1()>
/codebuild/output/src071433866/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:46 +0x9e
Goroutine 135 (running) created at:
<http://github.com/rudderlabs/rudder-server/rruntime.Go()|github.com/rudderlabs/rudder-server/rruntime.Go()>
/codebuild/output/src071433866/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:32 +0x4c
<http://github.com/rudderlabs/rudder-server/warehouse.(*HandleT).Setup()|github.com/rudderlabs/rudder-server/warehouse.(*HandleT).Setup()>
/codebuild/output/src071433866/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:900 +0x3c1
<http://github.com/rudderlabs/rudder-server/warehouse.monitorDestRouters()|github.com/rudderlabs/rudder-server/warehouse.monitorDestRouters()>
/codebuild/output/src071433866/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:992 +0xc56
<http://github.com/rudderlabs/rudder-server/warehouse.Start.func3()|github.com/rudderlabs/rudder-server/warehouse.Start.func3()>
/codebuild/output/src071433866/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:1502 +0x2f
<http://github.com/rudderlabs/rudder-server/rruntime.Go.func1()|github.com/rudderlabs/rudder-server/rruntime.Go.func1()>
/codebuild/output/src071433866/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:46 +0x9e
Goroutine 714 (running) created at:

rough-alligator-32210

09/20/2021, 8:27 AM

(please note the stack needs to be read bottom up)

rough-alligator-32210

09/20/2021, 8:27 AM

Any help would be greatly appreciated

aloof-appointment-91379

09/20/2021, 6:48 PM

how to connect rudderstack api to hubspot

billions-fireman-56323

09/21/2021, 5:34 AM

we use Branch and Mixpanel and I would like to send Branch attribution data to Mixpanel as people property here is the sample payload from Branch

Copy code

{
  "name": "open",
  "user_data": {
    "$mixpanel_distinct_id": "1234"
  },
  "last_attributed_touch_data": {
    "~id": 467391383381228200,
    "~feature": "marketing",
    "~campaign": "december_test",
    "~channel": "Facebook Organic",
    "product_id": "XBA8198j",
    "product_name": "Green Table AB10",
    "+url": "<https://branchster.app.link/test_linking>",
    "$marketing_title": "Deep Link Testing",
    "$ios_deepview": "branch_default",
    "+via_features": [
      "QUICK_LINKS"
    ]
  },
  "custom_data": {
    "reinstall": "false",
    "ip": "50.200.105.218",
    "referred": "false"
  },
  "timestamp": 1512681005807
}

anyone can help me on transforming this data to Mixpanel people property to get

~campaign

value?

bumpy-application-98923

09/21/2021, 5:43 AM

Hi all, I’m trying to set up salesforce as a destination following this guide: https://docs.rudderstack.com/destinations/crm/salesforce Specifically, I’m trying to create/update a Contact object off the back of certain events. I’ve added the externalId field as described in the docs, and it’s successfully creating the object. But if I want to update the object, it looks as though I need to know the salesforce ID of the object in order to update it. If I provide a value under

id

in the payload, e.g.

sf-contact-id

from the example in the docs, it will result in an error because no such object exists according to salesforce. If I set the id to a salesforce-generated ID, then it successfully updates the object. Is there any way of getting this to work using an ID for the entity that I provide myself, rather than the salesforce ID? Otherwise I guess I would have to store the salesforce ID somehow. The salesforce API supports upserting using an external ID custom field, so I think it should be possible for rudderstack to support this: https://developer.salesforce.com/docs/atlas.en-us.api_rest.meta/api_rest/dome_upsert.htm

quick-engineer-78417

09/21/2021, 6:11 AM

Hi 👋, In live events of source, I am getting

os

name and version always empty.

Copy code

"os": {
            "name": "",
            "version": ""
        }

Do I need to enable any parameter to capture

os

related info from client side?

cold-crowd-81787

09/21/2021, 10:48 AM

How can I make 2-factor authentication mandatory for all teammates? I'm not sure if this setting sets it up just for me or for everyone. I would also be great to have other 2FA options besides SMS by the way. We are currently on the free RudderStack Cloud plan, but would like to upgrade to a paid one soon.

happy-farmer-59927

09/22/2021, 4:13 AM

Hello, We are using Rudderstack from last couple of months. I have installed Rudderstack using docker setup in EC2 c4.xlarge instance. From the last 1 week, the docker container 'rudderlabs/rudder-server:1-alpine' keeps failing and we are getting below error. Can someone please have a look and let me know the fix for the issue.

ERROR   map[{rt_jobs_1 rt_job_status_1 1}:map[FIREBASE:map[:map[failed:No Jobs not_picked_yet:Query in progress throttled:No Jobs waiting:No Jobs]] FULLSTORY:map[:map[failed:No Jobs not_picked_yet:Query in progress throttled:No Jobs waiting:No Jobs]] GTM:map[:map[failed:No Jobs not_picked_yet:Query in progress throttled:No Jobs waiting:No Jobs]] HOTJAR:map[:map[failed:No Jobs throttled:No Jobs waiting:Query in progress]] HS:map[:map[failed:No Jobs throttled:No Jobs waiting:No Jobs]] MP:map[:map[failed:No Jobs not_picked_yet:Query in progress throttled:No Jobs waiting:No Jobs]] POSTHOG:map[:map[failed:No Jobs not_picked_yet:Query in progress throttled:No Jobs waiting:No Jobs]] SLACK:map[:map[failed:No Jobs not_picked_yet:No Jobs throttled:No Jobs waiting:No Jobs]]]]

ERROR  pq: could not resize shared memory segment "/PostgreSQL.472502037" to 4194304 bytes: No space left on device

bland-shoe-3836

09/22/2021, 6:39 AM

Hi folks, I'm wondering how to link group with users. And which destination support group mapping?

fancy-answer-79663

09/22/2021, 8:34 AM

Hi guys, I use cloud mode GA destination in self-hosted control plane. I have this issue with the site speed report on GA. Avg. Page Load Time report always shows zero, I also changed "Site Speed Sample Rate" to 100% but no luck. How can I fix this?

green-book-44596

09/22/2021, 11:05 AM

Hi there, I have a question related to Rudderstack <> Customer.io integration and user anonymisation. I observed that events are not pushed to Customer.io if the events are not identified (not calling identify method so leave them anonymous). Once I identify a user all events are push to CIO properly. Is that known limitation or am I doing something wrong?

late-carpet-65295

09/22/2021, 5:28 PM

Hi guys, events are not getting pushed to mixpanel. we have self hosted data plane. For last 5 hours, it is not synced. In Rudderstack live events, could see events being fired. How to analyse this further?

future-cartoon-38411

09/22/2021, 9:11 PM

Hello Rudderstack team, I have a question, is the Application Installed event not tracked on the flutter sdk?

future-cartoon-38411

09/22/2021, 9:17 PM

I think I found the answer, it looks like it is in fact not tracked, at least I can confirm it on iOS, the

__checkApplicationUpdateStatus

method is called too late in the initialization process,

UIApplicationDidFinishLaunchingNotification

has already been dispatched by then so it is not handled and installation is never checked

freezing-library-28789

09/23/2021, 8:12 AM

Hi Team #support I am trying to migrate data from PostgreSQL to MicrosoftSQL server. BTW these databases are in the AWS. But I am unable to fetch the schema and tables from the MicrosoftSQL server. Can anyone help me on this!!!

freezing-library-28789

09/23/2021, 8:17 AM

#support ^^

big-boots-25401

09/23/2021, 8:24 AM

Hello, we would like to prevent unauthorised websites from sending events using our write key and the JS SDK. Is there somewhere we can specify a whitelist of allowed origins ?

big-boots-25401

09/23/2021, 8:29 AM

Could someone here provide some insights on how the anonymous_id is generated and stored ? Is this a simple uuidv4 ? Is it stored in a first party cookie ? How long is it persisted ? Will it be affected by google phasing out tracking cookies in 2023 ? https://techcrunch.com/2021/06/24/is-google-about-to-delay-its-depreciation-of-track[…]J1xhmkO0STH1YxlkPWddLEP8LzAmP6AReKgPqENcLCtuWuPUqwcplq4rx8Wqu

fancy-answer-79663

09/23/2021, 10:25 AM

Hi everyone, Is there any plan for yandex metrica integration?

broad-jackal-62873

09/23/2021, 10:59 AM

Hi guys! How are you? 😉 I found a possible issue but don't know if you are working on it (or if it's a mistake from my side). I'm using selfhosted posthog with a purchased wildcard certificate. Trying to send events from Rudderstack, we're getting this error in the docker log:

2021-09-23T10:52:40.154Z	ERROR	router/network.go:165	Errored when sending request to the serverPost <https://POSTHOG_HOSTNAME.com/batch>: x509: certificate signed by unknown authority

It's is possible to add a custom CA certificate to the docker image? Can I do something to fix it? Thanks!

incalculable-finland-3638

09/23/2021, 1:53 PM

Trying to send data from redshift to hubspot and I am getting a network error.

aloof-appointment-91379

09/23/2021, 3:18 PM

Does rudderstack have a rest api

damp-lion-55692

09/23/2021, 5:01 PM

Hello. Some of the Syncs jobs that I've started early this morning have been running for several hours are not doing much and when I tried stopping the sync, nothing happens and I can not stop them. i.e. Run ID c565087nc17l0nlkns8g. Please advise. Thanks.

purple-knife-51559

09/24/2021, 12:33 AM

Hello Rudder team, We are seeing some errors when trying to send data to amplitude, any ideas on your end? All errors are happening from node-sdk source => amplitude destination. Logs from the transformer below:

Copy code

TypeError: Cannot set property '$add' of null
    at prepareTraitsConfig (/home/node/app/v0/destinations/am/transform.js:87:27)
    at handleTraits (/home/node/app/v0/destinations/am/transform.js:100:20)
    at responseBuilderSimple (/home/node/app/v0/destinations/am/transform.js:209:18)
    at processSingleMessage (/home/node/app/v0/destinations/am/transform.js:477:10)
    at toSendEvents.forEach.sendEvent (/home/node/app/v0/destinations/am/transform.js:591:22)
    at Array.forEach (<anonymous>)
    at Object.process (/home/node/app/v0/destinations/am/transform.js:590:16)
    at Promise.all.events.map (/home/node/app/versionedRouter.js:103:44)
    at Array.map (<anonymous>)
    at handleDest (/home/node/app/versionedRouter.js:99:12) []

We are not using any custom transformations, these should all be from default rudder-server => amplitude behavior.

late-carpet-65295

09/24/2021, 9:55 AM

Hi, with postgres destination, the sync is very slow. lag of 4 hours noticed. Any solution to it?