Skip to contents

Enrollment Data

Functions for fetching and processing NJ school enrollment data

fetch_enr()
Gets and processes a NJ enrollment file
fetch_enr_cached()
Fetch enrollment data with caching
fetch_enr_years()
Fetch multiple years of enrollment data with progress
tidy_enr()
Tidy enrollment data
enr_grade_aggs()
Custom Enrollment Grade Level Aggregates
id_enr_aggs()
Identify enrollment aggregation levels

Assessment Data (NJSLA/PARCC)

Functions for NJSLA (2019+) and PARCC (2015-2018) assessment results

fetch_parcc()
Gets and cleans up a PARCC data file
fetch_all_parcc()
Fetch all PARCC results
fetch_all_parcc_with_progress()
Fetch all PARCC/NJSLA results with progress
fetch_njgpa()
Fetch NJGPA (NJ Graduation Proficiency Assessment) data
fetch_all_njgpa()
Fetch all NJGPA results
fetch_access()
Fetch ACCESS for ELLs data
fetch_all_access()
Fetch all ACCESS for ELLs results
parcc_aggregate_calcs()
Aggregate multiple PARCC rows and produce summary statistics
parcc_percentile_rank()
Assessment proficiency percentile rank
parcc_perf_level_counts()
PARCC counts by performance level
tidy_parcc_subgroup()
Tidy PARCC subgroup names

Assessment Data (Legacy - NJASK/HSPA/GEPA)

Functions for historical NJ assessment data (2004-2014)

fetch_old_nj_assess()
a simplified interface into NJ assessment data
fetch_njask()
gets and processes a NJASK file
fetch_hspa()
gets and processes a HSPA file
fetch_gepa()
gets and processes a GEPA file
tidy_nj_assess()
tidies NJ assessment data

Graduation Data

Functions for graduation rates and counts

fetch_grad_rate()
Fetch Grad Rate
fetch_grad_count()
Fetch Grad Counts
fetch_6yr_grad_rate()
Fetch 6-Year Graduation Rate data
fetch_all_6yr_grad_rate()
Fetch all 6-Year Graduation Rate data
id_grad_aggs()
Identify graduation aggregation levels
grate_aggregate_calcs()
Aggregate multiple grad rate rows and produce summary statistics
gcount_aggregate_calcs()
Aggregate multiple grad count rows and produce summary statistics
grate_percentile_rank()
Graduation rate percentile rank
grate_validation_summary()
Get graduation rate validation summary
recover_suppressed_grate()
Recover suppressed district graduation rates from school data

Chronic Absence

Cross-state standard interface for chronic absenteeism data

fetch_absence()
Fetch Chronic Absenteeism Data (Cross-State Standard)
fetch_absence_multi()
Fetch Chronic Absenteeism Data for Multiple Years
tidy_absence()
Tidy chronic absenteeism data

School Performance Reports (SPR)

Functions for SPR database data (2017-2024)

fetch_spr_data()
Fetch SPR Data
list_spr_sheets()
List Available SPR Sheets
fetch_chronic_absenteeism()
Fetch Chronic Absenteeism Data
fetch_absenteeism_by_grade()
Fetch Absenteeism by Grade
fetch_days_absent()
Fetch Days Absent Data
fetch_sat_participation()
Fetch SAT/ACT/PSAT Participation Data
fetch_sat_performance()
Fetch SAT/ACT/PSAT Performance Data
fetch_ap_participation()
Fetch AP/IB Participation and Performance Data
fetch_ap_performance()
Fetch AP/IB Performance Data (Alias)
fetch_ib_participation()
Fetch IB Participation Data
fetch_cte_participation()
Fetch CTE Participation Data
fetch_industry_credentials()
Fetch Industry Valued Credentials Data
fetch_work_based_learning()
Fetch Work-Based Learning Data
fetch_apprenticeship_data()
Fetch Apprenticeship Data
fetch_biliteracy_seal()
Fetch Seal of Biliteracy Data
fetch_violence_vandalism_hib()
Fetch Violence/Vandalism/HIB Data
fetch_disciplinary_removals()
Fetch Disciplinary Removals Data
fetch_teacher_experience()
Fetch Teacher Experience Data
fetch_staff_demographics()
Fetch Staff Demographics Data
fetch_staff_ratios()
Fetch Student-Staff Ratio Data
fetch_dropout_rates()
Fetch Dropout Rate Data
fetch_essa_status()
Fetch ESSA Accountability Status
fetch_math_course_enrollment()
Fetch Math Course Enrollment Data

School/District Directories

Functions for school and district metadata

fetch_directory()
Fetch NJ School Directory Data
clear_directory_cache()
Clear directory data from session cache
get_school_directory()
Get NJ School Directory Data
get_district_directory()
Get NJ District Directory Data

Charter Aggregations

Functions for charter school sector aggregations

charter_sector_enr_aggs()
Calculate Charter Sector Enrollment Aggregates
charter_sector_gcount_aggs()
Calculate Charter Sector Grad Count aggregates
charter_sector_grate_aggs()
Calculate Charter Sector Grad Rate aggregates
charter_sector_matric_aggs()
Calculate Charter Sector postsecondary matriculation aggregates
charter_sector_parcc_aggs()
Calculate Charter Sector PARCC aggregates
charter_sector_spec_pop_aggs()
Calculate Charter Sector Special Populations Aggregates
charter_sector_sped_aggs()
Calculate Charter Sector SPED Aggregates
allpublic_enr_aggs()
Calculate All Public Enrollment Aggregates
allpublic_gcount_aggs()
Calculate Charter Sector Grad Count aggregates
allpublic_grate_aggs()
Calculate All Public Grad Rate aggregates
allpublic_matric_aggs()
Calculate All Public matriculation aggregates
allpublic_parcc_aggs()
Calculate All Public Options PARCC Aggregates
allpublic_spec_pop_aggs()
Calculate All City Special Populations aggregates
allpublic_sped_aggs()
Calculate Charter Sector SPED aggregates
id_charter_hosts()
Identify charter host districts

Special Populations

Functions for special education and other subgroup data

fetch_sped()
Fetch Special Education Classification Data
fetch_reportcard_special_pop()
Fetch Special Population data
fetch_chronic_absenteeism()
Fetch Chronic Absenteeism Data
fetch_all_chronic_absenteeism()
Fetch all Chronic Absenteeism data
sped_aggregate_calcs()
Aggregate multiple sped rows and produce summary statistics
spec_pop_aggregate_calcs()
Aggregate multiple special populations rows and produce summary statistics

Other Data Sources

Additional NJ DOE data functions

fetch_msgp()
Fetch mSGP
fetch_tges()
Fetch Cleaned Taxpayer's Guide to Educational Spending
fetch_many_tges()
Fetch Multiple Cleaned Taxpayer's Guides to Educational Spending
fetch_dfg()
Fetch NJ District Factor Group (DFG) data
fetch_postsecondary()
Fetch Postsecondary Enrollment Rates
get_one_rc_database()
Get Raw Report Card Database
get_merged_rc_database()
Combines school and district Performance Reports for 2017-on, when two files were released.
get_rc_databases()
Get multiple RC databases
get_dfg_districts()
Get districts in a specific District Factor Group
get_dfg_a_districts()
Get DFG A districts (highest-need peer group)

Utilities

Helper functions and lookups

pad_grade()
Pad grade level
pad_cds()
Pad CDS fields
pad_leading()
Pad leading digits
trim_whitespace()
Trim whitespace
slugify_district()
Slugify a district name for URL use
enrich_grad_count()
Enrich report card matriculation percentages with grad counts
enrich_matric_counts()
Enrich matriculation rates with counts from grad counts
enrich_rc_enrollment()
Enrich report card subgroup percentages with best guesses at subgroup numbers
enrich_school_city_ward()
Enrich School Data with City Ward
enrich_school_latlong()
Enrich School Data with Lat / Long
validate_end_year()
Validate end_year parameter
validate_grade()
Validate grade parameter
validate_grate_aggregation()
Validate graduation rate aggregation

Caching

Cache management functions

njsd_cache_clear()
Clear the session cache
njsd_cache_enable()
Enable or disable the session cache
njsd_cache_enabled()
Check if caching is enabled
njsd_cache_info()
Get cache statistics and information
njsd_cache_list()
List all cached items
njsd_cache_remove()
Remove a specific item from cache
njsd_progress_enable()
Enable or disable progress indicators

All Other Functions

Additional exported functions

SUBGROUP_PAIRS
Standard subgroup pairs for gap analysis
add_dfg()
Add DFG classification to district data
add_percentile_rank()
Add percentile rank columns for any metric
agg_enr_column_order()
Helper function to return aggregate enrollment columns in correct order
agg_enr_pct_total()
Helper function to support calculating pct_total on aggregate enr dataframes
agg_spec_pop_column_order()
Helper function to return aggregate special populations columns in correct order
agg_sped_column_order()
Helper function to return aggregate sped columns in correct order
allpublic_enr_aggs()
Calculate All Public Enrollment Aggregates
allpublic_gcount_aggs()
Calculate Charter Sector Grad Count aggregates
allpublic_grate_aggs()
Calculate All Public Grad Rate aggregates
allpublic_matric_aggs()
Calculate All Public matriculation aggregates
allpublic_parcc_aggs()
Calculate All Public Options PARCC Aggregates
allpublic_spec_pop_aggs()
Calculate All City Special Populations aggregates
allpublic_sped_aggs()
Calculate Charter Sector SPED aggregates
analyze_course_access_equity()
Analyze Course Access Equity
analyze_retention_patterns()
Analyze Staff Retention Patterns
calc_ap_access_rate()
Calculate AP/IB Access Rate
calc_discipline_rates_by_subgroup()
Calculate Discipline Rates by Subgroup
calc_staff_diversity_metrics()
Calculate Staff Diversity Metrics
calc_stem_participation_rate()
Calculate STEM Participation Rate
calc_student_staff_ratio()
Calculate and Analyze Student-Staff Ratios
calculate_access_rate()
Calculate equity access rate
calculate_agg_parcc_prof()
Aggregate PARCC results across multiple grade levels
calculate_subgroup_gap()
Calculate achievement gap between two subgroups
charter_city
Charter School Host District Mapping
charter_market_share()
Calculate charter market share for host cities
charter_sector_enr_aggs()
Calculate Charter Sector Enrollment Aggregates
charter_sector_gcount_aggs()
Calculate Charter Sector Grad Count aggregates
charter_sector_grate_aggs()
Calculate Charter Sector Grad Rate aggregates
charter_sector_matric_aggs()
Calculate Charter Sector postsecondary matriculation aggregates
charter_sector_parcc_aggs()
Calculate Charter Sector PARCC aggregates
charter_sector_spec_pop_aggs()
Calculate Charter Sector Special Populations Aggregates
charter_sector_sped_aggs()
Calculate Charter Sector SPED Aggregates
check_url_accessible()
Check if a URL is accessible
city_ecosystem_summary()
Summarize sector performance within a city
clean_cds_fields()
Clean up CDS field names
clean_sped_df()
Clean SPED data
clear_directory_cache()
Clear directory data from session cache
compare_discipline_across_years()
Compare Discipline Across Years
define_peer_group()
Define a peer comparison group
dfg_percentile_rank()
Calculate DFG peer percentile for any metric
district_matric_aggs()
Aggregates matriculation data by district
download_and_clean_pr()
Download and clean performance report data
ecosystem_trend()
Track sector ecosystem dynamics over time
enr_grade_aggs()
Custom Enrollment Grade Level Aggregates
enrich_grad_count()
Enrich report card matriculation percentages with grad counts
enrich_matric_counts()
Enrich matriculation rates with counts from grad counts
enrich_rc_enrollment()
Enrich report card subgroup percentages with best guesses at subgroup numbers
enrich_school_city_ward()
Enrich School Data with City Ward
enrich_school_latlong()
Enrich School Data with Lat / Long
extract_rc_AP()
Extract Report Card Advanced Placement Data
extract_rc_SAT()
Extract Report Card SAT School Averages
extract_rc_cds()
Extract Report Card CDS
extract_rc_college_matric()
Extract Report Card Matriculation Rates
extract_rc_enrollment()
Extract Report Card Enrollment
fetch_6yr_grad_rate()
Fetch 6-Year Graduation Rate data
fetch_absence()
Fetch Chronic Absenteeism Data (Cross-State Standard)
fetch_absence_multi()
Fetch Chronic Absenteeism Data for Multiple Years
fetch_absenteeism_by_grade()
Fetch Absenteeism by Grade
fetch_access()
Fetch ACCESS for ELLs data
fetch_all_6yr_grad_rate()
Fetch all 6-Year Graduation Rate data
fetch_all_access()
Fetch all ACCESS for ELLs results
fetch_all_chronic_absenteeism()
Fetch all Chronic Absenteeism data
fetch_all_njgpa()
Fetch all NJGPA results
fetch_all_parcc()
Fetch all PARCC results
fetch_all_parcc_with_progress()
Fetch all PARCC/NJSLA results with progress
fetch_ap_participation()
Fetch AP/IB Participation and Performance Data
fetch_ap_performance()
Fetch AP/IB Performance Data (Alias)
fetch_apprenticeship_data()
Fetch Apprenticeship Data
fetch_arts_enrollment()
Fetch Visual and Performing Arts Enrollment Data
fetch_biliteracy_seal()
Fetch Seal of Biliteracy Data
fetch_chronic_absenteeism()
Fetch Chronic Absenteeism Data
fetch_cs_enrollment()
Fetch Computer Science Enrollment Data
fetch_cte_participation()
Fetch CTE Participation Data
fetch_days_absent()
Fetch Days Absent Data
fetch_dfg()
Fetch NJ District Factor Group (DFG) data
fetch_directory()
Fetch NJ School Directory Data
fetch_disciplinary_removals()
Fetch Disciplinary Removals Data
fetch_dropout_rates()
Fetch Dropout Rate Data
fetch_enr()
Gets and processes a NJ enrollment file
fetch_enr_cached()
Fetch enrollment data with caching
fetch_enr_years()
Fetch multiple years of enrollment data with progress
fetch_essa_chronic_absenteeism()
Fetch ESSA Chronic Absenteeism data
fetch_essa_progress()
Fetch ESSA Accountability Progress
fetch_essa_status()
Fetch ESSA Accountability Status
fetch_gepa()
gets and processes a GEPA file
fetch_grad_count()
Fetch Grad Counts
fetch_grad_rate()
Fetch Grad Rate
fetch_hspa()
gets and processes a HSPA file
fetch_ib_participation()
Fetch IB Participation Data
fetch_industry_credentials()
Fetch Industry Valued Credentials Data
fetch_many_tges()
Fetch Multiple Cleaned Taxpayer's Guides to Educational Spending
fetch_math_course_enrollment()
Fetch Math Course Enrollment Data
fetch_msgp()
Fetch mSGP
fetch_njask()
gets and processes a NJASK file
fetch_njgpa()
Fetch NJGPA (NJ Graduation Proficiency Assessment) data
fetch_old_nj_assess()
a simplified interface into NJ assessment data
fetch_parcc()
Gets and cleans up a PARCC data file
fetch_postsecondary()
Fetch Postsecondary Enrollment Rates
fetch_reportcard_special_pop()
Fetch Special Population data
fetch_sat_participation()
Fetch SAT/ACT/PSAT Participation Data
fetch_sat_performance()
Fetch SAT/ACT/PSAT Performance Data
fetch_science_course_enrollment()
Fetch Science Course Enrollment Data
fetch_social_studies_enrollment()
Fetch Social Studies Enrollment Data
fetch_sped()
Fetch Special Education Classification Data
fetch_spr_data()
Fetch SPR Data
fetch_staff_demographics()
Fetch Staff Demographics Data
fetch_staff_ratios()
Fetch Student-Staff Ratio Data
fetch_teacher_experience()
Fetch Teacher Experience Data
fetch_tges()
Fetch Cleaned Taxpayer's Guide to Educational Spending
fetch_violence_vandalism_hib()
Fetch Violence/Vandalism/HIB Data
fetch_work_based_learning()
Fetch Work-Based Learning Data
fetch_world_language_enrollment()
Fetch World Language Enrollment Data
gap_percentile_rank()
Rank entities by achievement gap within peer group
gap_trajectory()
Track achievement gap trends over time
gcount_aggregate_calcs()
Aggregate multiple grad count rows and produce summary statistics
geocoded
Geocoded School Addresses
get_dfg_a_districts()
Get DFG A districts (highest-need peer group)
get_dfg_districts()
Get districts in a specific District Factor Group
get_district_directory()
Get NJ District Directory Data
get_essa_file()
Get an ESSA comprehensive or targeted accountability file
get_merged_rc_database()
Combines school and district Performance Reports for 2017-on, when two files were released.
get_one_rc_database()
Get Raw Report Card Database
get_percentile_cols()
Get percentile cols
get_rc_databases()
Get multiple RC databases
get_school_directory()
Get NJ School Directory Data
get_standalone_rc_database()
Get Standalone Raw Report Card Database
get_valid_grades()
Get valid grades for an assessment type and year
grate_aggregate_calcs()
Aggregate multiple grad rate rows and produce summary statistics
grate_percentile_rank()
Graduation rate percentile rank
grate_validation_summary()
Get graduation rate validation summary
id_charter_hosts()
Identify charter host districts
id_enr_aggs()
Identify enrollment aggregation levels
id_grad_aggs()
Identify graduation aggregation levels
identify_focus_schools()
Identify Focus Schools
kill_padformulas()
Kill Excel Formula Padding For Numeric Strings
layout_gepa
GEPA Fixed-Width File Layout
layout_gepa05
GEPA 2005 Fixed-Width File Layout
layout_gepa06
GEPA 2006 Fixed-Width File Layout
layout_hspa
HSPA Fixed-Width File Layout
layout_hspa04
HSPA 2004 Fixed-Width File Layout
layout_hspa05
HSPA 2005 Fixed-Width File Layout
layout_hspa06
HSPA 2006 Fixed-Width File Layout
layout_hspa10
HSPA 2010 Fixed-Width File Layout
layout_njask
NJASK Fixed-Width File Layout
layout_njask04
NJASK 2004 Fixed-Width File Layout
layout_njask05
NJASK 2005 Fixed-Width File Layout
layout_njask06gr3
NJASK 2006 Grade 3 Fixed-Width File Layout
layout_njask06gr5
NJASK 2006 Grade 5 Fixed-Width File Layout
layout_njask07gr3
NJASK 2007 Grade 3 Fixed-Width File Layout
layout_njask07gr5
NJASK 2007 Grade 5 Fixed-Width File Layout
layout_njask09
NJASK 2009 Fixed-Width File Layout
layout_njask10
NJASK 2010 Fixed-Width File Layout
list_spr_sheets()
List Available SPR Sheets
matric_aggregate_calcs()
Aggregate multiple postsecondary matriculation rows and produce summary statistics
matric_column_order()
Matriculation column order
njsd_cache_clear()
Clear the session cache
njsd_cache_enable()
Enable or disable the session cache
njsd_cache_enabled()
Check if caching is enabled
njsd_cache_info()
Get cache statistics and information
njsd_cache_list()
List all cached items
njsd_cache_remove()
Remove a specific item from cache
njsd_progress_enable()
Enable or disable progress indicators
nwk_address_addendum
Newark Address Addendum
pad_cds()
Pad CDS fields
pad_grade()
Pad grade level
pad_leading()
Pad leading digits
parcc_aggregate_calcs()
Aggregate multiple PARCC rows and produce summary statistics
parcc_percentile_rank()
Assessment proficiency percentile rank
parcc_perf_level_counts()
PARCC counts by performance level
percentile_rank()
Percentile Rank
percentile_rank_trend()
Calculate percentile rank change over time
print(<njsd_cache_info>)
Print cache information
prog_codes
NJ Program Codes
rc_numeric_cleaner()
Report Card Numeric Data Cleaner
recover_suppressed_grate()
Recover suppressed district graduation rates from school data
sector_gap()
Calculate performance gap between charter and district sectors
sector_percentile_comparison()
Compare percentile ranks across sectors
slugify_district()
Slugify a district name for URL use
spec_pop_aggregate_calcs()
Aggregate multiple special populations rows and produce summary statistics
sped_aggregate_calcs()
Aggregate multiple sped rows and produce summary statistics
sped_lookup_map
Special Education District Lookup Map
tges_name_cleaner()
TGES name cleaner
tidy_absence()
Tidy chronic absenteeism data
tidy_budgetary_per_pupil_cost()
Tidy Budgetary Per Pupil data frame
tidy_enr()
Tidy enrollment data
tidy_nj_assess()
tidies NJ assessment data
tidy_parcc_subgroup()
Tidy PARCC subgroup names
tidy_tges_data()
Tidy list of TGES data frames
tidy_vitstat()
Tidy Vital Statistics
track_essa_progress_over_time()
Track ESSA Progress Over Time
trim_whitespace()
Trim whitespace
trunc2()
Truncate with configurable precision
validate_end_year()
Validate end_year parameter
validate_grade()
Validate grade parameter
validate_grate_aggregation()
Validate graduation rate aggregation
verify_data_urls()
Verify all configured URLs for a data type
ward_enr_aggs()
Aggregates enrollment data by ward
ward_gcount_aggs()
Aggregates grad counts data by ward
ward_grate_aggs()
Aggregates grad rate data by ward
ward_matric_aggs()
Aggregates matriculation data by ward
ward_parcc_aggs()
Aggregates assessment data by ward