Can we have a rows filter where we can use column with value so that we can only filter and replicate only few rows from source to destination?

No this isn’t possible today. Airbyte ingest all your data from your source. You can use dbt to execute this analytical step.