Spark Big Data Platform to Manage City Traffic
Pilar Rey del Castillo
Journal of Information Technology Review, Vol. 11, No. 3, 2020.
DOI: https://doi.org/10.6025/jitr/2020/11/3/94-104
Link: http://www.dline.info/jitr/fulltext/v11n3/jitrv11n3_2.pdf
Abstract:
Electronic sensors are able to generate statistical data based huge amount of data files. This is possible when the traffic dataset are available in open data portal. Electronic data is produced from traffic sensors and serve as a rich source of information, that provides speed, vehicle count and so on. It is important that traffic data needs to be processed at the micro-level using complex workloads. Thus the normal data processing tasks require big data specific
tools. Initially we have used a few stages in producing short-term indicators of the evolution of the traffic flow variable in a city using the Spark big data platform. With the help of the data on the sensorsâ€™ geographical location, the indicators are then analyzed to assess the impact of some recent local government measures used to ease the pollution and traffic
flow.