Building Permits

Data details

There are 327,422 rows and 7 columns. The data source¹ is used to create our data that is stored in our pins table. You can access this pin from a connection to posit.byui.edu using hathawayj/permits.

This data is available to all.

Variable description

• state: State FIPS code
• StateAbbr: State abbreviation
• county: County FIPS code
• countyname: County name
• variable: Variable name
• year: Year
• value: Value

Variable summary

Variable type: numeric

skim_variable	n_missing	complete_rate	mean	sd	p0	p25	p50	p75	p100	hist
state	0	1	30.09	15.31	1	18	29	45	56	▅▇▆▆▇
county	0	1	98.50	106.80	1	33	75	127	840	▇▁▁▁▁
year	0	1	1994.65	8.88	1980	1987	1995	2002	2010	▇▆▇▆▆
value	0	1	308.32	1238.69	1	9	38	163	70225	▇▁▁▁▁

Variable type: character

skim_variable	n_missing	complete_rate	min	max	empty	n_unique	whitespace
StateAbbr	0	1	2	2	0	51	0
countyname	0	1	10	43	0	1823	0
variable	0	1	11	22	0	6	0

devtools::install_github("hathawayj/buildings")
library(buildings)

pacman::p_load(tidyverse, fs, sf, arrow, googledrive, downloader, fs, glue, rvest, pins, connectapi)

board <- board_connect()

permits <- buildings::permits

pin_write(board, permits, type = "parquet", access_type = "all")
pin_name <- "permits"
meta <- pin_meta(board, paste0("hathawayj/", pin_name))
client <- connect()
my_app <- content_item(client, meta$local$content_id)
set_vanity_url(my_app, paste0("data/", pin_name))

Access data

This data is available to all.

Direct Download: permits.parquet

R and Python Download:

URL Connections:

For public data, any user can connect and read the data using pins::board_connect_url() in R.

library(pins)
url_data <- "https://posit.byui.edu/data/permits/"
board_url <- board_connect_url(c("dat" = url_data))
dat <- pin_read(board_url, "dat")

Use this custom function in Python to have the data in a Pandas DataFrame.

import pandas as pd
import requests
from io import BytesIO

def read_url_pin(name):
  url = "https://posit.byui.edu/data/" + name + "/" + name + ".parquet"
  response = requests.get(url)
  if response.status_code == 200:
    parquet_content = BytesIO(response.content)
    pandas_dataframe = pd.read_parquet(parquet_content)
    return pandas_dataframe
  else:
    print(f"Failed to retrieve data. Status code: {response.status_code}")
    return None

# Example usage:
pandas_df = read_url_pin("permits")

Authenticated Connection:

Our connect server is https://posit.byui.edu which you assign to your CONNECT_SERVER environment variable. You must create an API key and store it in your environment under CONNECT_API_KEY.

Read more about environment variables and the pins package to understand how these environment variables are stored and accessed in R and Python with pins.

library(pins)
board <- board_connect(auth = "auto")
dat <- pin_read(board, "hathawayj/permits")

import os
from pins import board_rsconnect
from dotenv import load_dotenv
load_dotenv()
API_KEY = os.getenv('CONNECT_API_KEY')
SERVER = os.getenv('CONNECT_SERVER')

board = board_rsconnect(server_url=SERVER, api_key=API_KEY)
dat = board.pin_read("hathawayj/permits")

Footnotes

1. https://github.com/hathawayj/buildings