Slackbot
03/30/2023, 8:37 PMBen Krug
03/30/2023, 9:39 PMBen Krug
03/30/2023, 9:39 PMMadhav Gunampalli
03/30/2023, 9:46 PMJohn Kowtko
03/30/2023, 10:14 PM2020-02-01:00:00:00 <= time < 2020-03-01:00:00:00. (my syntax not exact)Madhav Gunampalli
03/31/2023, 6:44 PMPARTITIONED BY HOUR it works fine. I do not want to load this data with too many segments by hourMadhav Gunampalli
03/31/2023, 6:46 PMREPLACE INTO "${target} OVERWRITE
WHERE __time >= TIMESTAMP '2022-12-01 00:00:00' AND __time < TIMESTAMP '2023-03-30 00:00:00'
SELECT * from "${source}" WHERE __time >= TIMESTAMP '2022-12-01 00:00:00' AND __time < TIMESTAMP '2023-03-30 00:00:00'
PARTITIONED BY MONTHJohn Kowtko
04/01/2023, 3:16 PMREPLACE INTO test_mo OVERWRITE
WHERE __time >= TIMESTAMP '2022-12-01 00:00:00' AND __time < TIMESTAMP '2023-07-01 00:00:00'
SELECT * from test_mo WHERE __time >= TIMESTAMP '2022-12-01 00:00:00' AND __time < TIMESTAMP '2023-07-30 00:00:00'
PARTITIONED BY MONTH
The OVERWRITE clause should have both dates be on the 1st of the month ... in the SELECT clause you can see my time range was shorter, but it still worked. Your example about had the OVERWRITE end date on 3/30, which is not correct, it should be 4/1.
If you use 4/1 and it still doesn't work, then the only other thing I can think of that could be an issue is timezone? Did you change default timezone on your cluster? I don't know if timezone actually matters here or if all is assumed UTC, but it is a thought of what to check next.Madhav Gunampalli
04/03/2023, 4:46 PM