straight-machine-93573
11/09/2021, 4:52 PMhandsome-animal-43816
11/09/2021, 10:46 PMloud-architect-29049
11/10/2021, 10:10 AMJava heap space
. Until today it ran without any problems. Not sure what I can do, as even if i try resync them, same errors occur (for same tables):mammoth-waiter-38325
11/10/2021, 12:28 PM{
"type": "track",
"event": "user_created",
"sentAt": "2021-11-10T12:26:45.825Z",
"context": {
"traits": {},
"library": {
"name": "rudder-sdk-ruby-sync",
"version": "1.0.7"
}
},
"rudderId": "42b258fb-b5a8-44a6-b80b-aca1e7ea3eb4",
"messageId": "e6edbf42-6832-4263-bdce-4394f53501af",
"timestamp": "2021-11-10T12:26:45.825Z",
"properties": {
"user_id": 517,
"user_name": "John Hendriecks",
"user_email": "<mailto:carsten+rudder3@paperless.io|carsten+rudder3@paperless.io>",
"user_locale": "en_US",
"user_position": "Founder / CEO",
"user_created_at": "2021-11-10T12:26:43.721Z",
"user_registration_type": "organic",
"user_registration_provider": "email",
"user_marketing_tracking_data": {}
},
"receivedAt": "2021-11-10T12:26:46.181Z",
"request_ip": "116.203.74.70",
"anonymousId": "96a2136b-5838-4653-acc0-b0c549eb342e",
"integrations": {
"All": true
},
"originalTimestamp": "2021-11-10T12:26:47.551Z"
}
full-river-3253
11/10/2021, 7:05 PM""
?
Where can I get it if I’m on a free account (not open source)?adorable-motorcycle-95377
11/11/2021, 1:18 AMsparse-engine-48042
11/11/2021, 6:06 AMastonishing-gpu-91544
11/11/2021, 1:15 PMdriver: bad connection
We didn't enable SSL for our ClickHouse server and so Secure is not enabled. We can immediately connect to our ClickHouse server via DataGrip or DBeaver. What is the problem?
Maybe there's a problem with your driver.kind-toothbrush-21628
11/12/2021, 12:37 PMOnly available in RudderStack Cloud
To use warehouse action Sources, try RudderStack Cloud, or Contact sales.
?straight-machine-93573
11/12/2021, 2:13 PMstraight-machine-93573
11/12/2021, 2:13 PMstraight-machine-93573
11/12/2021, 2:14 PMnarrow-rain-89253
11/12/2021, 2:15 PMagreeable-army-26912
11/12/2021, 2:20 PMstraight-machine-93573
11/12/2021, 3:13 PMstraight-machine-93573
11/12/2021, 3:13 PMstraight-machine-93573
11/12/2021, 3:13 PMstraight-machine-93573
11/12/2021, 3:14 PMproud-honey-75875
11/12/2021, 3:28 PMfamous-artist-36900
11/12/2021, 5:26 PMstraight-machine-93573
11/13/2021, 6:41 AMFailed to trigger uploads for destId= 20qpG0ZMlqvjleYQ5hPhCqArvEe: rpc error: code = Internal desc = grpc: error while marshaling: proto: Marshal called with nilThe sync work and we see the details if we hit refresh button
cold-twilight-47953
11/15/2021, 8:16 AMenough-notebook-37540
11/15/2021, 12:45 PMgw_
tables, but does not seem to do anything in the transformer. I do not see anything in the live view
section of the transformer (no errors), but the transformers seem to be doing something (CPU is active).full-river-3253
11/15/2021, 1:35 PMbroad-hair-28734
11/15/2021, 3:22 PMrecover.mode_normal
).
Currently I'm mystified. That specific metric doesn't seem to get published, whereas a bunch of other metrics are. I've tried a couple of the docker image versions from docker hub: 1-alpine
, 11112021.092401
, and 02112021.103757
, but none show the metric. The strange thing is that if I run from source, with the same configuration, on the same git version (8a3b7376c5172ba7387b68eadd5ffb85b5f6e3c2
), then the metric does show up. Any idea where to look next? Happy to provide further details to debug.rhythmic-pizza-93292
11/15/2021, 5:48 PMgw_jobs
table I can see my event in there, but gw_job_status
doesn't show any errors, and neither does proc_error_*
tables. What else can I do to debug this?adorable-motorcycle-95377
11/15/2021, 11:06 PMstraight-machine-93573
11/15/2021, 11:51 PMhandsome-animal-43816
11/16/2021, 6:02 AM<bucketname>/<foldername>/<randomString>/<yyyy-mm-dd>/<uuid>.json.gz
e.g
<bucketname>/<foldername>/<randomString>/<2021-11-16>/<uuid>.json.gz
I’d like to partition the data like so
<bucketname>/<foldername>/<randomString>/year=<yyyy>/month=<mm>/day=<dd>/<uuid>.json.gz
e.g
<bucketname>/<foldername>/year=2021/month=11/day=16/<uuid>.json.gz
So I’d like to remove the random string, and partition the data based on the year/month/day it is received.
Interested to hear how others using S3 as a source this have approached this ?
There is a possibility of piping to kineses and then partitioning.refined-stone-1555
11/16/2021, 7:47 AM