NeoNomade | Scraping hellhound
07/14/2025, 10:29 AMisaacolads
07/17/2025, 9:45 PMNeoNomade | Scraping hellhound
07/17/2025, 9:46 PMcelnarapify
07/23/2025, 7:49 AMtypescript
const originalErrorLog = crawler.log.error.bind(crawler.log);
crawler.log.error = (message: string, data?: Record<string, unknown> | null) => {
if (message.includes(HIDE_MESSAGE_WATERMARK)) {
return;
}
originalErrorLog(message, data);
};
Other option is to enqueue a new request and update its retryCount and uniqueKey