AIS Data Mining

A Pipeline for Pre-Processing, Cleansing, and Visualizing AIS data with Ports Network Generation

During my M.Sc. at the University of Pisa, I had the opportunity to work as a visiting student at the Institute for Big Data Analytics at Dalhousie University. I focused on AIS data for cruise ships. After developing a pipeline for preprocessing, cleansing, and generating a network of ports in Python for the ship data, I designed a dashboard to visualize the Automatic Identification System (AIS) trajectories of vessels. Given the high volume of points characterizing these trajectories, efficient visualization was crucial. To achieve this, I applied the Douglas-Peucker line simplification algorithm to simplify the polylines of trajectories. Subsequently, I plotted trajectories at various levels of detail. When zoomed out, a coarse representation of trajectories is displayed, while zooming in reveals finer details. I incorporated this functionality by extending the Polyline class of Leaflet.js. Specifically, when in a zoomed-out view and the number of points falls below a predefined threshold, the trajectory points are displayed. Otherwise, only the polylines are shown, and the points are discarded.

Dashboard with the Ports Network and speed distribution chart. Zoomed view with points revealed.