Is the `SynchronousLocalTaskExecutor` (with `Paral...
# hamilton-help
s
Is the
SynchronousLocalTaskExecutor
(with
Parallelizable/Collect
) pretty hit or miss? Or do I jut happen to use it on odd file types (
xlsb
,
xlsm
). For some reason it takes quite a long time >15 for one file using the this executor. I scaled it down to 1 file since the full batch was taking alarmingly long as a sanity check. Could the speed issue be? 1. The file type (
xlsm
,
xlsb
) a. The same transforms ran in <1min for a single file without the executor. 2. The
SynchronousLocalTaskExecutor
needs a bit more understanding/setup to perform properly.
s
How big are the files?
This is a good question for office hours — since I think pairing on the code would help clarify a few things.
👍 1
Unless you can share the code 🙂
s
Yeah office hours would probably sort it quicker. The file is 28000 KB