Unit 2 Stretch Task: Comparing Delay Types - Pivot

Published

October 29, 2025

Note

Canvas: U2: Stretch Task — Comparing Delay Types: Pivot
Type: Stretch Task (1 pt, complete/incomplete)
Copilot: Allowed for syntax lookup; disallow for answer generation.

Background

Delayed flights are not something most people look forward to. In the best case scenario you may only wait a few extra minutes for the plane to be cleaned. However, those few minutes can stretch into hours if a mechanical issue is discovered or a storm develops. Arriving hours late may result in you missing a connecting flight, job interview, or your best friend’s wedding.

In 2003 the Bureau of Transportation Statistics (BTS) began collecting data on the causes of delayed flights. The categories they use are Air Carrier, National Aviation System, Weather, Late-Arriving Aircraft, and Security. You can visit the BTS website to read definitions of these categories.

Client Request

The JSON file for this project contains information on delays at 7 airports over 10 years. Your task is to clean the data, search for insights about flight delays, and communicate your results to the Client. The Client is a CEO of a flight booking app who is interested in the causes of flight delays and wants to know which airports have the worst delays. They also want to know the best month to fly if you want to avoid delays of any length.

Data

Every data science project should start with data, and our class projects are no different. Each project will have ‘URL’ and ‘Information’ links like the ones below. Right click the ‘URL’ link and select “Copy Link” to use it to import the data into your project. This is the preferred method to get data into your report as you will be publishing your report to GitHub. If you choose to download the data file to your computer you will need to save it in the same folder as your .qmd file for it to work correctly in GitHub.

URL: JSON File
Information: Data Description
Subject Matter: Types of Delay

Readings

Python Polars: The Definitive Guide, Chapter 15, Reshaping (especially the intro, pivot and unpivot)

Optional / Alternative Reading

Polars Cookbook, Chapter 8, Reshaping and Tidying Data

Stretch Questions

Skills: pivot / unpivot, reshaping for comparisons

  1. Which delay is the worst delay? Keep working with the cleaned dataset you created in the previous task. Compare the proportion of flights delayed due to Carrier, to Security, and to Late Aircraft. Show this comparison in a Chart and a Table. Describe your results.

  2. Create another chart that shows the proportion of delays for each reason (Carrier, Security, and Late Aircraft) across all 7 airports. Describe your results.

Submission / Deliverables:

No template is provided. You must create your own file. Answer the questions. Each answer should include a written description of your results, code cells with comments, charts and/or tables._

Your instructor will advise you — or it will be evident in Canvas — whether to submit a rendered .html file, or a link to the rendered file on GitHub Pages (gh-pages). Do not submit the URL to the GitHub .qmd file.

When you have completed the report and are ready to submit, render the project into HTML and publish it to GitHub Pages. Follow these steps:

  1. Have this assignment’s template/quarto file open in VS Code and nothing else
  2. Click the Preview button in VS Code (top right of the screen)
    1. This renders the project so you can review it
    2. Confirm everything displays as you would like it to
    3. How you see it is how it is viewed for grading
    4. If there is an error in any cell, the rendering stops and you will need to fix the error before rendering again (if you get stuck post your error in Slack)
  3. Once the report is confirmed, close the preview and open the GitHub Desktop application
  4. Confirm you are in the correct repository (top left corner)
  5. Confirm you are on the Main branch (top left corner — never change off Main)
  6. Type a summary of the changes in the Summary box
  7. Click Commit to main (blue button, bottom left)
  8. Click Push origin (blue button, middle right)
    1. This pushes your changes to GitHub
    2. The publish.yml workflow renders the project into HTML files
    3. The HTML files are published to the gh-pages branch
    4. The URL of the published project is in the deployment section on GitHub
      1. In GitHub Desktop, click Open in GitHub to navigate to the repository
      2. Click the Actions tab and confirm there were no errors in rendering
      3. Open the deployment section on the main repo page to find the URL
      4. Navigate to the URL and confirm it displays as you intended
      5. Copy the URL and submit it in Canvas
Back to top