Showing posts with label CENSUS. Show all posts
Showing posts with label CENSUS. Show all posts

Wednesday, September 23, 2015

Video: Free and Open Source GIS Reference Data

After last week's post looking at the landscape of free and open source GIS software, the next logical step is looking at open GIS data. This video looks at reference data. I am still deciding on what to do the next video on...the choices are a) Open data portals, b) novel data types, social media (TwitteR and Instagram), or c) remote sensing.  Let me know what you would like to see in the comments below.


Topics covered in the video include:
Census: https://www.census.gov/geo/maps-data/data/tiger.html
DataFerrett: http://dataferrett.census.gov/
Summary File 1 DVD: https://www.census.gov/mp/www/cat/decennial_census_2010/summary_file_1_1.html
Natural Earth: http://www.naturalearthdata.com/
OpenStreetMap: https://www.openstreetmap.org/
GeoNames: http://www.geonames.org/
US Board on Geographic Names:http://geonames.usgs.gov/domestic/index.html
Maryland Department of Planning/ACS: http://www.mdp.state.md.us/msdc/S7_ACS.shtml

Wednesday, July 2, 2014

Summary File 1 DVDs: Quick Access to Detailed Census Data

The U.S. Census Bureau has done a better job of getting data online in consumable formats, most notably adding shapefiles and geodatabases containing demographic, social, and economic data.  Room for improvement remains.  One additional source is a free set of DVDs that contain data at various geographies and levels of detail for variables in Summary File 1.  No Access tables need to be created or linked or statistical code run.
"Summary File 1 (SF 1) contains the data compiled from the questions asked of all people and about every housing unit."
The two DVDs are split into a US Summary and National File (for larger geographies).  Installing both requires 20 GB of free space. A quick overview can be found on the Census website.

Most importantly, the DVDs include a 'data engine' that makes selecting data easier by a variety of criteria including geographic unit, variables of interest, and output format (i.e. *.csv, *.shp, etc.).  There are numerous file types for exporting data.  Summary information can also be displayed in a report format.  The information contained in the DVDs is far more detailed than can be easily found elsewhere.

  • For example, the DVDs contain counts of people for single-year age groups.  
After installing the data engine at data from at least one of the DVDs, you click an icon and get prompted to create a workspace/folder.  You then proceed to pick a geography, output (file type or report), variables, and custom/derived variables that are of interest. A workspace can also be saved for future use.

A screenshot from the Census website showing the data engine
and tabs that you will work through to get your data.
Arrows show how to get started, basic navigation, and the help button.
I have used the DVDs at my work and it is a much more efficient way to navigate through census data, especially if you are near a deadline.  Unfortunately, accessing other census data, such as Summary File 2, remains more challenging.  Be sure to check with your local or state planning agency to see if they have census data posted on their website in shapefiles or spreadsheets for easy use.

Lastly, if you are interested in data from the American Community Survey, be sure to check out the TIGER Products website and the Summary Data Retrieval Tool (direct download link).

Tuesday, April 15, 2014

Exploring Health Insurance Estimates by County Using GeoDA

Health insurance has been an important topic over the last several months, with the opening and closing of open enrollment at HealthCare.gov.  Most recently, the Census released its first estimates of health insurance coverage at the census tract level.  Typically, estimates have been made for county-level data which is what I explore here from the Small Area Health Insurance Estimates (SAHIE) Program.

I used the latest build of GeoDA 1.5/Beta/preview to explore spatial patterns in 2012 estimates for the percent of population that is uninsured under age 65 by county.  I examined a univariate Local Moran's I and a bivariate example using the percent below the poverty level.

If you have not used GeoDA before to conduct exploratory spatial data analysis (ESDA), you need to give it a try.  The latest build features more data import/export and editing options, a significant improvement over earlier versions.
Some of GeoDA's features are either a) not present in ArcGIS and its extensions or b) only found in ArcGIS Advanced, formerly ArcInfo, namely the creation of spatial weights using polygon contiguity/adjacency. (Note: You can create weights in ArcGIS, based on distance for example.)
To help keep all maps uniform, I imported the results into QGIS. Click on any image below to magnify it. You can find definitions for the terms and statistics used here.

Map of Percent Uninsured by County
Regionally, the South and West US have a smaller percent of counties with low rates of uninsured compared to the Midwest and Northeast. Or rather, they have a higher percent of counties with high rates of uninsured.
For the official map, for comparison, visit here.

LISA Map of Percent Uninsured by County
The map below shows clusters of counties with high, low, low-high, and high-low rates of uninsured.  Light grey areas were not statistically significant.  Spatial weights were created for queen contiguity, 1st order/neighbors.

Global (p=0.02) and local autocorrelation are present.  
The Moran scatter plot of percent uninsured vs.
lagged/neighboring counties has a r-squared value of 0.74 

LISA Map of Percent Uninsured and Percent Below the Poverty Line
Lastly, I examined a bivariate LISA of the percent uninsured and percent below the poverty line (all ages). For this map, I also included the outline of states.  Interestingly, there was no across-the-board global association, as one might expect.  However, state policies undoubtedly affect the percent insured.

No global autocorrelation (p=0.51) but local autocorrelation is present in parts of states or throughout most of particular states, for example the low percent uninsured (and low percent in poverty) in Massachusetts which underwent significant healthcare reform in 2006.  What do you think about some of the other states?

Affordable Care Act Implementation
Unfortunately, some of the states that could benefit the most from the Affordable Care Act (ACA) did not move to implement, as evidenced in this map from the Commonwealth Fund.

Those States sprinting ahead with implementation and those sitting it out.
Bottom line: GeoDA and QGIS are a potent combination.  GeoDA's import, export, and data editing features are much improved.   It is a vital tool for learning and conducting spatial analysis.  However, a few other components of GeoDA are worth mentioning including: making cartograms and conditional maps, connectivity histograms, and performing spatial regression.  As implementation of the ACA moves ahead, it will be interesting to see changes or lack of changes in the percent insured.

QGIS Tip:  Save the symbol styles (categorized) for the cluster types (LISA_CL variable) after you make them, since they can be saved, loaded, and used again for any map layer created in GeoDA as long as you don't change the default variable names.  This is a huge time saver. 

Saturday, May 18, 2013

Census Data: Easier to Use

The Census Bureau has come a long way by offering census data in formats that can be easily imported into GIS software.  Whether at small or large scales, census data are vital to any analysis.  Of course, census data are free, even though some companies charge!  In addition, it is noteworthy to add census data can be ordered on DVD and includes user friendly tools to help extract the data you need.

Previously, and in still in some cases, attribute data would have to be joined with shapefiles.  The TIGER/Line page now features demographic and social data pre-joined to shapefiles and geodatabases for users that are not familiar with joining and managing such complex data. Click the map below to enlarge it.

US Population Counts by County and Cities with Population Greater than 250,000

Data from the American Community Survey (ACS) 5-year estimates can also be downloaded easily.  However, more can be done and more ready-to-use files could be created--resources allowing!  Hopefully, the Census will be able to maintain what they are doing and expand in the future.

Family Size (Purple/Red = Greater than 1 Standard Deviation above the mean, Blue = Below, No Color = Mean to 1 SD Above).  Both maps are derived from data in the Summary Demographic Profile 1.

Maps made with QGIS

Sunday, March 4, 2012

The Road to Somewhere...

Open geographic data sources are great, but there are pitfalls...Take roads, for example.  Many GIS files for roads are created for different reasons and different periods of time.  Precision roads for navigation can be pricey.  The choice of road files can have a direct impact on the project you are working on.  The below shows roads from the U.S. Census Bureau (red) compared against the center line file from an open city data warehouse (black). The census data actually have a line/road going through the sports stadium.  In some places, red lines appear where there are no black lines and vice versa.