We currently have a multitude of trucks that travel long hours every day. The data is in
.csv format which has timestamp, truck ID, longitude and latitude. One file for a given truck and given day can contain more than 2000 rows. What would be the best approach to process the data, bearing in mind that we want to create statistics based on each truck for a given day? Should we break the file per truck and per day into chunks or should we tweak the
app.config file? If we were to break the file into chunks how would be be able to merge the outputs of each chunk back together to get the full route?
I tried modifying the
waypoints parameter in the
app.config file to 2100 but then I get the message
The approximated route distance must not be greater than 200000.0 meters.