To remove a folder, you need to use

rclone purge

. Be careful though, as this can delete your entire bucket if used incorrectly