blue-accountant-37241
08/17/2022, 7:34 PMhigh-sunset-48515
08/17/2022, 9:50 PMlemon-dog-49453
08/18/2022, 9:38 AMtack Depth set: 64
Interval Bytes set: 524288
Master 18 is running []
Worker 27 is online []
Worker 33 is online []
Worker 40 is online []
Worker 42 is online []
Stack Depth set: 64
Interval Bytes set: 524288
Stack Depth set: 64
Interval Bytes set: 524288
Stack Depth set: 64
Interval Bytes set: 524288
Stack Depth set: 64
Interval Bytes set: 524288
Worker 40 started []
Worker 33 started []
Worker 42 started []
Worker 27 started []
Error: read ECONNRESET
at TCP.onStreamRead (internal/stream_base_commons.js:209:20)
Error encountered while executing transformation: Script execution timed out. []
Error: Script execution timed out.
at /home/node/app/util/customTransformer-v1.js:34:11
at async userTransformHandlerV1 (/home/node/app/util/customTransformer-v1.js:82:27)
at async userTransformHandler (/home/node/app/util/customTransformer.js:237:24)
at async /home/node/app/versionedRouter.js:414:39
at async Promise.all (index 0)
at async /home/node/app/versionedRouter.js:377:7
at async bodyParser (/home/node/app/node_modules/koa-bodyparser/index.js:95:5)
at async /home/node/app/middleware.js:22:5 []
Error encountered while executing transformation: Script execution timed out. []
Error: Script execution timed out.
at /home/node/app/util/customTransformer-v1.js:34:11
at async userTransformHandlerV1 (/home/node/app/util/customTransformer-v1.js:82:27)
at async userTransformHandler (/home/node/app/util/customTransformer.js:237:24)
at async /home/node/app/versionedRouter.js:414:39
at async Promise.all (index 0)
at async /home/node/app/versionedRouter.js:377:7
at async bodyParser (/home/node/app/node_modules/koa-bodyparser/index.js:95:5)
at async /home/node/app/middleware.js:22:5 []
Error: read ECONNRESET
at TCP.onStreamRead (internal/stream_base_commons.js:209:20)
Error: read ECONNRESET
at TCP.onStreamRead (internal/stream_base_commons.js:209:20)
Error encountered while executing transformation: Script execution timed out. []
Error: Script execution timed out.
at /home/node/app/util/customTransformer-v1.js:34:11
at async userTransformHandlerV1 (/home/node/app/util/customTransformer-v1.js:82:27)
at async userTransformHandler (/home/node/app/util/customTransformer.js:237:24)
at async /home/node/app/versionedRouter.js:414:39
at async Promise.all (index 0)
at async /home/node/app/versionedRouter.js:377:7
at async bodyParser (/home/node/app/node_modules/koa-bodyparser/index.js:95:5)
at async /home/node/app/middleware.js:22:5 []
Error encountered while executing transformation: Script execution timed out. []
Error: Script execution timed out.
at /home/node/app/util/customTransformer-v1.js:34:11
at async userTransformHandlerV1 (/home/node/app/util/customTransformer-v1.js:82:27)
at async userTransformHandler (/home/node/app/util/customTransformer.js:237:24)
at async /home/node/app/versionedRouter.js:414:39
at async Promise.all (index 0)
at async /home/node/app/versionedRouter.js:377:7
at async bodyParser (/home/node/app/node_modules/koa-bodyparser/index.js:95:5)
at async /home/node/app/middleware.js:22:5 []
future-architect-34957
08/18/2022, 2:06 PMReverse ETL is not available for this product tier.
Upgrade your plan to unlock unlimited reverse ETL sources.
With a button "Upgrade Plan" which leads me to https://www.rudderstack.com/pricing where it says the Reverse-ETL come in the Free plan
Does that mean the Reverse-ETL feature isn't available for the open source version ?happy-table-58658
08/18/2022, 4:54 PMpurple-knife-51559
08/18/2022, 6:06 PMjobsdb=> SELECT
pgClass.relname AS tableName,
pgClass.reltuples AS rowCount
FROM
pg_class pgClass
INNER JOIN
pg_namespace pgNamespace ON (pgNamespace.oid = pgClass.relnamespace)
WHERE
pgNamespace.nspname NOT IN ('pg_catalog', 'information_schema') AND
pgClass.relkind='r'
ORDER BY
rowCount;
tablename | rowcount
------------------------------+--------------
...
wh_load_files | 1.617937e+06
wh_table_uploads | 1.821724e+06
jobsdb=> select count(*) from wh_table_uploads;
count
---------
1852287
(1 row)
(I can’t imagine we need this many rows?)
And here’s the error we see during the crash:
2022/08/18 05:22:15 http: panic serving [::1]:49470: read tcp 127.0.0.1:34218->127.0.0.1:5432: read: connection reset by peer
goroutine 2965 [running]:
net/http.(*conn).serve.func1()
/usr/local/go/src/net/http/server.go:1802 +0xb9
panic({0x1d5ce40, 0xc0054600a0})pin
/usr/local/go/src/runtime/panic.go:1047 +0x266
<http://github.com/bugsnag/bugsnag-go/v2.(*Notifier).AutoNotify(0x5b|github.com/bugsnag/bugsnag-go/v2.(*Notifier).AutoNotify(0x5b>, {0xc0005f83a0, 0x2, 0x2})
/go/pkg/mod/github.com/bugsnag/bugsnag-go/v2@v2.1.2/notifier.go:102 +0x1c9
panic({0x1d5ce40, 0xc0054600a0})
/usr/local/go/src/runtime/panic.go:1038 +0x215
<http://github.com/rudderlabs/rudder-server/warehouse.processHandler(|github.com/rudderlabs/rudder-server/warehouse.processHandler(>{0x2499f68, 0xc0008f40e0}, 0xc000899f00)
/rudder-server/warehouse/warehouse.go:1291 +0xca5
net/http.HandlerFunc.ServeHTTP(0xc001eefb00, {0x2499f68, 0xc0008f40e0}, 0xc000fa39c8)
/usr/local/go/src/net/http/server.go:2047 +0x2f
net/http.(*ServeMux).ServeHTTP(0x24b8ef0, {0x2499f68, 0xc0008f40e0}, 0xc000899f00)
/usr/local/go/src/net/http/server.go:2425 +0x149
<http://github.com/bugsnag/bugsnag-go/v2.Handler.func1(|github.com/bugsnag/bugsnag-go/v2.Handler.func1(>{0x2499f68, 0xc0008f40e0}, 0xc000899d00)
/go/pkg/mod/github.com/bugsnag/bugsnag-go/v2@v2.1.2/bugsnag.go:182 +0x387
net/http.HandlerFunc.ServeHTTP(0x0, {0x2499f68, 0xc0008f40e0}, 0x0)
/usr/local/go/src/net/http/server.go:2047 +0x2f
net/http.serverHandler.ServeHTTP({0x2494c08}, {0x2499f68, 0xc0008f40e0}, 0xc000899d00)
/usr/local/go/src/net/http/server.go:2879 +0x43b
net/http.(*conn).serve(0xc000477720, {0x24b8ef0, 0xc0005de660})
/usr/local/go/src/net/http/server.go:1930 +0xb08
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:3034 +0x4e8
notice warehouse.processHandler is where the crash comes from.
We also see a large number of simultaneous job executions (to be expected?)
jobsdb=> select job_state, count(job_state) from gw_job_status_2482 group by 1;
job_state | count
-----------+--------
executing | 100019
succeeded | 100019
(2 rows)
Our PSQL server has continuously high load. it starts at about 50%, then jumps to 100% until our server crashes, at which point it drops back to ~50%
Is there some fix for this? Maybe clearing out all these millions of rows in the db?important-chef-56588
08/18/2022, 10:34 PMadamant-wolf-85350
08/18/2022, 11:09 PMfreezing-analyst-62166
08/19/2022, 8:43 AM{
"error": "ga4AppInstanceId must be provided under externalId"
}
We use the exatly same format, as described:
rudderanalytics.track('Product List Viewed', {
list_id: "related_products",
category: "Related_products",
products: [{
product_id: "507f1f77bcf86cd799439011",
name: "Monopoly: 3rd Edition",
coupon: "SUMMER_FUN",
category: "Apparel",
brand: "Google",
variant: "green",
price: "19",
quantity: "2",
position: "1",
affiliation: "Google Merchandise Store",
currency: "USD",
discount: 2.22,
item_category2: "Adult",
item_category3: "Shirts",
item_category4: "Crew",
item_category5: "Short sleeve",
item_list_id: "related_products",
item_list_name: "Related Products",
location_id: "L_12345"
}]
}, {
externalId: [{
type: "ga4AppInstanceId",
id: appInstanceId
}],
});
Do you have a hint, how we can solve the error?famous-exabyte-58706
08/19/2022, 5:36 PMproud-animal-97803
08/19/2022, 5:52 PM2 errors occurred:
1 errors occurred:
EOF
1 errors occurred:
EOF
It’s not providing any transparency on why it failed or anything actionable. Is there a way to find out how to fix this, or is this a bug caused by some internal updates of RS?helpful-truck-5495
08/19/2022, 5:53 PMnumerous-hamburger-74848
08/21/2022, 7:56 PMred-furniture-88611
08/22/2022, 3:52 PMfresh-window-35674
08/22/2022, 4:29 PMrich-furniture-49524
08/22/2022, 4:39 PMmessageId
field
Could you explain the reason for this behaviour ?brash-van-58951
08/22/2022, 8:28 PMstraight-lawyer-40627
08/23/2022, 10:59 AMstraight-raincoat-91897
08/23/2022, 11:54 AMbulky-waitress-58430
08/23/2022, 1:30 PMfew-toddler-98389
08/24/2022, 12:51 AMfew-appointment-33266
08/24/2022, 7:08 AMcolossal-match-56275
08/24/2022, 7:57 AMwonderful-shoe-37547
08/24/2022, 8:25 AMworried-minister-21433
08/24/2022, 8:28 AMrudderstack-sdk-js
installed through NPM for app built with NextJS/others? Not to make analytics work server side, but just so that it doesn't crash when being loaded. Or if someone knows of a workaround? As soon as I load the lib in my app it crashes because it attempts to access the window object...
Thankschilly-diamond-93546
08/24/2022, 10:10 AMchilly-diamond-93546
08/24/2022, 10:11 AMchilly-diamond-93546
08/24/2022, 10:12 AMbusy-pillow-19385
08/25/2022, 12:29 AMe.push
it refers the one on rudderstack sdkdazzling-carpet-37005
08/25/2022, 3:30 AM