Projects walkthroughs, tool teardowns, interviews, and more.
Articles tagged: data
Data Stories That Aren’t Downers
By Erin KissanePosted on
Last week, ProPublica’s Olga Pierce wrote to the NICAR-L list asking for help putting together a list of “happy data stories” or stories related to the arts, at the request of some of her students.
How to Save DNAInfo/Gothamist Bylines
By Erin KissanePosted on
The owner of the DNAInfo and Gothamist family of local news websites shut the sites down today, which means that not only are all their 115 journalists out of work, but all their bylines—and all the vital information in their years of reporting—is gone.
What We Learned from Staring at Social Media Data for a Year
By Lam Thuy VoPosted on
The things you learn from staring at social media data for a year.
SRCCON Spotlight: Keeping Data Stories Human
By Erin Kissane and William Wolfe-WyliePosted on
One of the SRCCON 2016 sessions that attendees talked about most was “Keeping People at the Forefront of Data Stories,” facilitated by William Wolfe-Wylie and based on his experience working on the CBC News project, “Missing and Murdered: The Unsolved Cases of Indigenous Women and Girls.”
Competition Be Damned
By Erin KissanePosted on
Last Wednesday, the Trump Inaugural Committee’s FEC filing appeared on the FEC site in its horrible hand-delivered image-PDF glory. ProPublica’s Derek Willis noted its arrival on Twitter.
Cleaner, Smarter Spreadsheets Start with StructurePosted on
Make better spreadsheets by thinking about structure, from the beginning.
Notes on Working with Big-ish Data
By Mike StuckaPosted on
I finished a project with a home-built table that was about 16GB, some 60 million rows by 110ish fields. It was…big. Sometimes it was painful. Mostly, though, it worked out, and it got us what I think is a damned good story. Anyway, I think it was Ben Welsh who’d observed something like: We have some good tools to work with Big Data, but not great tools for data that’s not quite so big. I ran into that situation.
How The Chicago Reporter Made ‘Settling for Misconduct’
By Matt Kiefer and Julia SmithPosted on
In researching Settling for Misconduct, we had to account for details from hundreds of county and federal court filings, identify thousands of officers named in civil complaints and tally hundreds of millions of dollars in monetary awards. We also needed thorough reporting to connect issues of police misconduct to fiscal accountability. And oh yeah – we had to have a slick web app to present the data to the public.
What I Learned Recreating One Chart Using 24 ToolsPosted on
Lessons learned from trying to create one chart with as many applications, libraries, and programming languages as possible.
Introducing Elex, a Tool to Make Election Coverage Better for Everyone
By Jeremy Bowers and David EadsPosted on
“End the elections arms race” has become a rallying cry in American data journalism. Many newsrooms spend tremendous resources writing code to simply load and parse election data. It’s time we stopped worrying about the plumbing and started competing on the interesting parts. We decided it was time we put some code against our beliefs – our contribution is a tool we’re calling Elex. And it needs your help, too.
Introducing agate: a Better Data Analysis Library for JournalistsPosted on
Meet agate, a Python data analysis library optimized not for performance, but for the performance of the human who is using it. That means focusing on designing code that is easy to learn, readable, and flexible enough to handle any weird data you throw at it. Here’s why you should try it.
Tracking Amtrak 188Posted on
How curiosity and tinkering let Al Jazeera America publish historical data for a derailed train’s route without Amtrak’s cooperation.
By Ed SummersPosted on
Sometimes you write a piece of software and it gets used for purposes you didn’t quite imagine at the time. Sometimes you write a piece of software and it unexpectedly rearranges your life.
Consider the Boolean
By Jacob HarrisPosted on
The challenge of using binary data structures in a complicated world.
Understanding Households and Relationships in Census DataPosted on
The Census Bureau’s population counts make trends in household makeup easy to track. All you need are two things: an understanding of how the Census asks Americans about households and relationships, and where to find the right tables amid the haystack of tabulations. That’s what this post aims to help you with.
By Derek WillisPosted on
Derek Willis breaks down the three stages of scraping (denial, annoyance, and acceptance) while confronting the election-results form from hell.
Marriage Data: It’s Complicated
By D’Vera CohnPosted on
D’Vera Cohn on everything you ever wanted to know about marriage data, but were afraid to ask.
Everything You Ever Wanted to Know About Elections Scraping
By Jeremy B. Merrill and Ken SchwenckePosted on
Jeremy Merrill and Ken Schwencke explore the fine art of anticipating and catching errors while wrangling the eccentricities of US elections data.
The Census of Governments Has Your Number
By Mike MaciagPosted on
Michael Maciag’s walk-through of this under-utilized goldmine.
Finding Stories in Census DataPosted on
Emily Alpert Reyes on how to find promising needles in Census haystacks.