Here are some numbers for the USA. Filtering/splitting in the master node (1 core) takes 1,493s, on workers (256 cores) takes 429s , i.e. the speedup is only of a factor of 3.5.
Here are some numbers for the USA. Filtering/splitting in the master node (1 core) takes 1,493s, on workers (256 cores) takes
429s , i.e. the speedup is only of a factor of 3.5.