Why not to split the task into smaller ones if you know it takes so long... eg per 1k inputs. Can't see reason not doing that. Another question is what in the hell can take 10 hours when scraping 30k inputs, thats 3k per hour, 1 per sec, that's almost manual job...is that some multivel deep javascript event handling scraping?