Back to portfolio

PROJECT / BIG-DATA-ANALYSIS

Data at scale.

PySparkCassandraScikit-learn

My Big Data final project: analysis of monthly passenger counts at San Francisco International Airport, with data exploration, preparation and regression.

Academic project

What you can explore

This is the final project I completed during my Big Data training at Tokio School. I analysed monthly passenger records from San Francisco International Airport: the notebooks cover CSV exploration, comparisons by airline and region, data preparation for Cassandra, and linear regression with PySpark. The repository contains the notebooks and reports; there is no interactive app.

What the project tells us

The CSV is a working copy of Air Traffic Passenger Statistics, published by San Francisco Open Data under the PDDL 1.0 licence. It contains aggregated monthly counts; a row does not represent an individual flight. The regressions use a random 80/20 split, so their results describe that analysis rather than a test of future traffic forecasts. The repository preserves the notebooks and reports from the academic project.

Source code