PROJECT / BIG-DATA-ANALYSIS
Data at scale.
My Big Data final project: analysis of monthly passenger counts at San Francisco International Airport, with data exploration, preparation and regression.
Academic projectWhat you can explore
This is the final project I completed during my Big Data training at Tokio School. I analysed monthly passenger records from San Francisco International Airport: the notebooks cover CSV exploration, comparisons by airline and region, data preparation for Cassandra, and linear regression with PySpark. The repository contains the notebooks and reports; there is no interactive app.
What the project tells us
The CSV is a working copy of Air Traffic Passenger Statistics, published by San Francisco Open Data under the PDDL 1.0 licence. It contains aggregated monthly counts; a row does not represent an individual flight. The regressions use a random 80/20 split, so their results describe that analysis rather than a test of future traffic forecasts. The repository preserves the notebooks and reports from the academic project.