@mysterious-appointment-61638 can you check the rt_job_status_xx table and check the error response column. also which destinations are you using along with Posthog?

👋 Hello, team!

i am trying to create a new setup using docker-compose on centos

i have been. running into issue with the following error

panic: Could not run warehouse database migrations: Could not run migration from directory 'warehouse', Dirty database version 1. Fix and force version. [recovered] panic: Could not run warehouse database migrations: Could not run migration from directory 'warehouse', Dirty database version 1. Fix and force version. [recovered] panic: Could not run warehouse database migrations: Could not run migration from directory 'warehouse', Dirty database version 1. Fix and force version. goroutine 13 [running]: github.com/bugsnag/bugsnag-go.AutoNotify(0xc0004f5d40, 0x3, 0x3) /codebuild/output/src817977568/src/github.com/rudderlabs/rudder-server/vendor/github.com/bugsnag/bugsnag-go/bugsnag.go:109 +0x2bc panic(0x1580c40, 0xc000126040) /root/.goenv/versions/1.13.8/src/runtime/panic.go:679 +0x1b2 github.com/rudderlabs/rudder-server/rruntime.Go.func1.1(0x1bb9c00, 0xc000496e40) /codebuild/output/src817977568/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:43 +0x39a panic(0x1580c40, 0xc000126040) /root/.goenv/versions/1.13.8/src/runtime/panic.go:679 +0x1b2 github.com/rudderlabs/rudder-server/warehouse.setupTables(0xc0008dc0c0) /codebuild/output/src817977568/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:858 +0x127 github.com/rudderlabs/rudder-server/warehouse.Start() /codebuild/output/src817977568/src/github.com/rudderlabs/rudder-server/warehouse/warehouse.go:984 +0x1d0 main.startWarehouseService(...) /codebuild/output/src817977568/src/github.com/rudderlabs/rudder-server/main.go:154 main.main.func5() /codebuild/output/src817977568/src/github.com/rudderlabs/rudder-server/main.go:356 +0x21 github.com/rudderlabs/rudder-server/rruntime.Go.func1(0x1886770) /codebuild/output/src817977568/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:46 +0x81 created by github.com/rudderlabs/rudder-server/rruntime.Go /codebuild/output/src817977568/src/github.com/rudderlabs/rudder-server/rruntime/goroutine-factory.go:32 +0x3f

Hi @creamy-grass-84108 Was the new docker image released? The one that fixes https://github.com/rudderlabs/rudder-server/issues/503

@wooden-notebook-24208 Not yet, our release cycle is generally 1 month. So, official release would be in the last week of December. We are setting up a release process for this. We will share the build here.

Hello! I have been using the Python SDK as source and Apache Kafka as destination. I'm able to send out events from my source but I'm unable to view them on Kafka. I would appreciate any help on this, thanks!

Hi all, I discovered today that my Google BigQuery connection has not been working since Nov the 6th

I clicked on "test destination" inside the Rudderstack web app; the results are erroneous

I've two Google BigQuery destinations; o f them started malfunctionig on 11-03, the other one started malfunctioning on 11-06

when i say malfunctioning, I simply mean that my BigQuery house stopped receiving data since those dates

I did not receive any errors / notifications / etc

If you are hosting RudderStack yourself, can you check the wh_uploads table in Postgres too? For possible errors

Hi everyone...I'm a noob wondering how I can set up RudderStack with UserPilot...like what I would need on UserPilot's JS SDK end in order to set up UserPilot as a destination? Thanks for any info.

hey, @strong-branch-63526 thanks for joining the community. @adamant-airplane-7907 and @glamorous-mouse-54282 can give you more information on developing a destination

I'm running RudderStack open source on docker on a VPS. It is fillling up my disk usage; causing Docker to go to 80gb+.

Can I clean some log files etc to bring disk usage down? I suppose this would be a common issue

If not, how can I diagnose what files/folders are exactly causing high disk usage? Thanks

for reference (the 80gb vps is now out of space)

The postgres volume might be taking up the space. Things to check: 1. Verify your server is running in normal mode. Can be checked by hitting <data_plane_url>/health. If not, unprocessed data might have piled up in the postgres. 2. Disable backups by setting env

RSERVER_JOBS_DB_BACKUP_ENABLED

to false. Default is true and if credentials for backup storage provider is missing, it might cause pile up of tables in postgres. You can delete all such tables (starting with

pre_drop_

in postgres.

{"server":"UP", "db":"UP","acceptingEvents":"TRUE","routingEvents":"TRUE","mode":"NORMAL","goroutines":"640", "backendConfigMode": "API", "lastSync":"2020-12-09T07:26:35Z", "lastRegulationSync":""}

Seems like it's in normal mode at least. I'm trying to figure out how to view/delete postgres tables within docker now, thanks.

docker exec -it {postgres_container_name} sh

run this command to get into postgres container

Thanks,

docker exec -it rudder_db_1 psql -U username -W dbpass

worked

is this the problem? Growing "gw_jobs_1" and "batch_rt_1"? What is the way to fix it?

I couldn't find anything

pre_drop_

related -- am I looking at the right place?

Yes, the postgres tables seem normal. You can do

/dt+

to check table sizes

You're correct; they seem okay. Where could the problem be?

Can you check which docker volume is actually taking up the space you mentioned

I see why my tables look okay; I restarted docker with force update. That caused the volume to become unlinked.

docker volume prune

fixed things. Thanks for the assistance and for teaching me new things!