The datasource should be available during the duration of the replace command and it should be showing the state of the datasource before the replace is run.
REPLACE is a an all-or-nothing job, like most jobs in Druid, therefore if it fails, the current datasource would remain untouched.