Category: Uncategorized

Colorado’s COVID-19 Experience Part 4: How COVID-19 Impacts Quality of Life

The Corona Insights team wanted to know how Coloradans were holding up during shelter in place, so we conducted a survey! We asked residents about a broad range of topics, including their overall wellbeing, challenges, concerns, community response, and others.

All posts in this series:

As a part of our blog series recapping results from our COVID-19 Experience Survey, we wanted to dig deeper into our data and understand why some Coloradans said their quality of life had dropped significantly during shelter in place while others reported about the same wellbeing as before all of this started.

Wellbeing in Crisis

In order to assess changes in quality of life, we asked respondents a couple of questions. First, “On a scale of 0 (not good at all) to 10 (great), how would you rate your quality of life right now?” Next, we posed a similar question to understand how respondents would rate their quality of life “before the start of the COVID-19 situation.” Ideally, we would have been surveying these respondents over a few months, asking the original question at various time periods to develop “pre” and “post” scores to analyze. Many of our evaluation projects employ this strategy; the present circumstances, obviously, did not allow for us to go this route. However, by asking Coloradans to think back to their quality of life before the start of the pandemic, we can create a reasonable measurement of change by subtracting their “pre” scores from their post (or “during”) COVID quality of life score.

As reported in Part 1 of this series, Coloradans said that their quality of life dropped by a score of 1.4, or by about 18%, on average. However, this average only tells part of the story. While around a third of the state reported a one or two-point drop, more than a quarter of residents said their quality of life had decreased more substantially since the beginning of the pandemic. While a small percentage of the state (7%) actually said their life had gotten better during shelter in place, almost a third reported no change.

What explains this wide range of outcomes? Unsurprisingly, our analysis suggests those hit hardest economically reported the largest decreases in quality of life. Additionally, Coloradans who were socially isolated during shelter in place fared worse than those living with, and consistently interacting with, others. In the next section, we detail our key findings related to quality of life changes. If you are interested in how we estimated these results, or how to interpret regression analysis you can continue reading into our “How to Analyze the Data” section.

Continue reading

10 tips for facilitating your next Zoom meeting

If you live in Colorado, especially Denver, it is likely you will still be conducting the majority, if not all, of your team meetings virtually, even as some states and municipalities begin to chart their gradual paths to recovery.  

As we adjust to the new reality of virtual meetings as the new norm, we’ve been gathering some tips, tricks, and resources for all of you who are having to adjust to conducting meetings online and to developing a new facilitation skill set you never knew you had or needed.

Photo by Allie on Unsplash

3 classic facilitation tips that will optimize your virtual meeting (in other words, these always apply):

Continue reading

The Future of Qual

Photo by Ross Findon on Unsplash

For years, qualitative market research has been dominated by focus groups and one-on-one interviews. Each methodology offers benefits. However, as timelines shrink and research objectives expand, it may be time to rethink our “go-to” qualitative methods. This blog will discuss the shortcomings of traditional methods and how refreshed methodological approaches can overcome these pitfalls.

Co-creation Activities

We all know the stereotype—a focus group room with a two-way mirror providing a thin veil between participants and researchers. It has long been argued that this barrier maximizes participants’ comfort and allows for authentic, unbiased, discussions. The two-hour focus group is typically designed as a question-answer format with activities peppered throughout to break up the monotony. Historically, activities ask participants to complete a task individually and then share their thoughts and responses with the group. This approach is especially effective when delving into emotions or personal reactions. However, researchers are increasingly designing focus group activities that are group-based and co-created.

At Corona, we have eagerly implemented co-creation activities for marketing campaign and message testing projects. In 2019, we were working with a local association developing messaging for a new nonprofit giving-based program called Refund What Matters. Participants were asked to get in groups of 2-3 and create a print advertisement for the program. More specifically, they were asked to come up with a visual for the print ad, a tagline, and a hashtag. The client observed as the participants worked together to create their advertisements. The advertisements revealed the inner thoughts and motivations for nonprofit giving and the discussion between participants while creating the advertisements provided insight into how Colorado residents may try and pitch this giving program to their family members, peers, and coworkers.

Continue reading

Wrapping up 20 in ’19

To help celebrate our 20th Anniversary in 2019 we profiled one client and one Coronerd (i.e. Corona staff person) per month, as well as the Coronerd’s charity of choice, to which Corona donated $500 on their behalf.

Here’s a look back at our profiles from 2019. Thank you for following along throughout our 20th anniversary year!


It has been a great year of revisiting our clients, many of which have been an integral part of Corona’s 20 years. One of the best parts of our jobs is learning about our clients’ worlds – from airports to museums, and from government to nonprofits – we love learning about, and contributing to, the work being accomplished in our communities.

Click on each logo below to read their interview.


Corona wouldn’t be where it’s at today without our dedicated team. Without our people, there is no Corona. So, we wanted to reintroduce you to our team, what makes them tick, and what they bring to Corona.

Click on each staff person’s image below to learn about each Coronerd.

Matt Bruce, Associate
Kevin Raines, CEO and Principal
David Kennedy, Principal


As our work is community focused, we wanted our celebration to also be about our community. So along with highlighting our staff, we made a donation in honor of each team member to a charity of their choice. Check out their selections by clicking each organization’s logo below.

To stay up to date on all Corona news, and receive useful insights in the world of research, evaluation, and strategy, subscribe to our newsletter.

2020 Election Cycle Brings Spotlight to Colorado

It may feel like the 2018 midterms just passed, but once again, the nation is headed toward another election cycle. The 2020 election cycle will put Colorado in the spotlight, but not just as a purple state. We have a new primary voting system, a Senator is up for re-election, and some of our state’s political stars are setting their sights on the national stage. In this context, over the next 14 months Colorado residents and voters can expect to find themselves at the heart of national dialogues about voting access and political ideologies.

Photo by Element5 Digital on Unsplash
Continue reading

Turbocharging Transformation for the College of Arts, Humanities & Social Sciences at DU

The creative engine of a great university is its faculty. They pursue new knowledge, create unique approaches to address long-standing problems, and innovate the learning experience. Along the way, they imagine new possibilities, incubate ideas, experiment with alternative models, and discard what doesn’t work. Design thinking is in their DNA. 

… the 20th century model of delivering a liberal and creative arts education is inadequate to the task of developing graduates who can think broadly and critically in and out of their chosen fields, skills essential to career and life success as called out in DU IMPACT 2025.

Keystone Strategic Plan, Page 5
Continue reading

Big data is not required for big insights


You’ve probably heard a lot about Big Data. Big Data is going to change the world. Big Data is going to change how organizations are run. Big Data is going to clean our garage and walk our dog.

Big Data vs. Small/Medium Data

And maybe Big Data will do that–for big organizations. If you’re Coke or the Fermilab or the National Security Agency, your products or services or spying naturally produce a lot of data. Tapping into and harvesting massive streams of continuously created data, which is the hallmark of Big Data, is a natural thing to do.

But for many of us who work at small and medium organizations, Big Data is an abstraction at best. We simply don’t have massive, ongoing data streams that we can dive into to learn about our markets, our products or services, our clients, or our organization. We’re not big enough to have Big Data. But that doesn’t mean we can’t learn from the principles behind this phenomenon and use them to our advantage.

The hype around Big Data is the data itself: massive, previously unattainable and unimaginable rivers of data pouring through your world. But the philosophy behind Big Data is actually more important. It’s about looking around to identify where those data flows are in your own environment and then tapping into them to gain insight. You don’t need Big Data to do that. It works just as well with Medium Data or Small Data, especially if you’re a medium or small organization. We too can tap into and harvest data; it just flows in smaller quantities at our scale.

Three sources from which to harvest data

So how can we start this harvesting? What can we collect? There are three main sources to consider, though we’ll concentrate mostly on the third one.

First, you can harvest data that already exists outside your organization and is updated regularly. For example, there are lots of federal surveys and data collection efforts out there, and they’re very cost-effective to retrieve if you know about them. The right ones can help you understand your environment.

Second, you can create data via ongoing special efforts, such as conducting a regular survey or instituting a special data collection effort that is not part of your daily operations. This is a bit of a different concept from harvesting data, but still falls within the realm of a streaming source of data you can use for analysis.

But the third concept is the core of where Small Data can help you. It’s the implementation of a system to collect and harvest on an ongoing basis the data that we produce in our daily operations. Or more precisely, it’s data that we do or could produce easily in our daily operations.

Focus on the third

Thinking about that third concept, we all have opportunities to gather data on a daily basis. Most likely, we already do to some extent, even if it’s as simple as our client names or time sheets. So we’re already in the habit of creating data. But how are we using that data? As examples, I’m always surprised by the number of organizations that record their clients’ ZIP codes but then never use that data to examine their clients’ demographic and geographic makeup I’m also surprised by the number of nonprofits that don’t do research on their donor databases to identify their demographic sweet spots. This data is often collected but not often analyzed and leveraged to their full extent.

Beyond harvesting data that already exists, is there other data that we can efficiently build into our routines that can add value, either in understanding our clients, serving our clients, or improving our internal operations and efficiency? My company, for example, began tracking the origins of our consulting engagements a few years ago, and it has been very effective both in identifying inefficient means of marketing and effective ones. Our minor investment in that effort has paid itself back many times over.

There is value in data. We all know that. The key, of course, is to manage the process so you’re gathering valuable data in an efficient manner and then actually using it to your benefit. If you think about evaluating a program, a general rule of thumb is that 5 to 15 percent of the budget should be invested in evaluation, depending on the size of program. If you would make that investment in a program, why not follow the same rule for your organization as a whole? It may pay off handsomely.



This blog was originally posted on CausePlaent.org, “Where nonprofit leaders get smarter faster”.

The Power of Numbers

Numbers are an interesting thing. We all have an innate sense of quantities, but numbers are a culturally agreed upon format for representing those quantities. When we are trying to convey quantitative information to other people, the choice between “7 days” vs. “1 week” or “100 out of 300” vs. “1 out of 3” often feels like an aesthetic preference. However, the way we represent quantitative information to other people can have a large impact on how people think about what those numbers represent. As data scientists, it is our job to be aware of the ways in which people represent quantities to ensure that survey respondents’ perception of numbers accurately represents reality.

In creating survey instruments, I am always acutely aware of these factors. At the annual meeting of the Society for Personality and Social Psychology that I recently attended, I was fascinated by new research by Andrew White and Virginia S.Y. Kwan on the matter. They hypothesized that a small number of large units (e.g. 1 week) feels more distant and less probable than a large number of small units (e.g. 7 days). In one study, they described a fictional disease and then told people that someone in their community had been infected. The location of the infected person was either described as 1 mile away or as 5280 feet away. They then asked people how willing they were to receive the vaccination for the disease. People were much more willing to receive the vaccine when the location of the infected person was described as 5280 ft relative to when the location was described as 1 mile. This research is fascinating because the two conditions described the exact same amount of physical distance; however, the units used to describe the distance changed people’s perception of the threat.

I think I could hypothesize that the reverse is also true. That is, people might use large numbers of smaller units to describe things that feel closer and more probable and, on the other hand, might use smaller numbers of large units to describe things that feel far away and less probable. So if someone thinks a deadline is urgent, she might describe it as only 14 days away, instead of describing it as two weeks away. When designing surveying and analyzing people’s responses, it is important to understand how numbers can convey more than just quantitative information. As data scientists, we design research methods that capture not only data, but also the nuances of quantitative information.

Part 2: The NFL’s Talent Pool and Expansion

In our previous blog, we came to the conclusion that the if you average the ratios over each decade, we end up with an average talent pool of 9.62 million people per team, which is almost exactly the current ratio. Therefore, the fact that we have 32 teams right now means that the league’s expansion has merely kept pace with long-term growth. They aren’t overexpanding and they aren’t underexpanding in terms of keeping the talent pool constant.

Using an average talent pool of 9.627 million people per team to keep our on-field talent consistent, we see that new teams should be added each decade as the American population grows, as shown below.





Population Per Team


























































To keep the talent level consistent, we should add 3 new teams by 2020, 4 more new teams by 2030, 3 more teams by 2040, and 4 more teams by 2050.  This would add 14 new teams by 2050, giving us a 46-team league.

Now, where should those teams go?

No authoritative body develops state-level population projections for every state, so we cheated a little bit. We examined state populations in 2000 and 2010, and applied that growth rate to each subsequent decade. This allowed us to develop some very rough projections of the population of each state for the years 2020, 2030, 2040, and 2050, assuming that current growth rates persist over the next 40 years.  (This is unlikely, but come on, this is a blog post, not a dissertation.)

We then lumped the states (and Washington DC and Puerto Rico) into 16 regions to better account for regional fan bases. This conglomeration was arbitrary, but is likely not overly controversial.  For each of the sixteen regions, we then calculated the number of current teams and the number of teams that the region should have based on population, and added teams to the areas that were most underrepresented. This model therefore takes into account the number of teams already present, the current population, and population growth trends.

So what do we see as we look into our demographic crystal ball?  Well, a proper expansion of the NFL should be as follows, and we’ll let the NFL determine how to account for having an odd number of teams.

The list below includes the region that would get the new team, and the likely city location if the new franchise is placed in the largest metro area.

Year 2020 – Add three teams, one each in:

California – Los Angeles (Does this surprise anybody?)

The Great Plains (OK, KS, NE, SD, ND) – Oklahoma City is the largest metro area in the region.  This is probably a surprise, but this area has no team and a pretty good-sized population.  (And for you geographically impaired readers, the Kansas City Chiefs are located in Missouri, not Kansas.)

Texas – San Antonio is up, as the Cowboys lose a little of their fan base.

Year 2030 – Add four teams, one each in:

Texas again – It should go to Fort Worth based on demographics, but given their proximity to Dallas, would that happen?  If not, Austin would be the next city in line.

The desert SW (NV, UT, AZ, NM) – Las Vegas is the largest city without a team.  And can you imagine going to a road game in Vegas?  Talk about a home field advantage.

The Atlantic South (NC, SC, GA) – Raleigh is the largest city without a team.  Move over, Panthers; there’s a new team in the Carolinas.

The deep South (AR, AL, MS, LA) – Birmingham is the largest city with a team, and come on, this is a town that would support an NFL team.

Year 2040 – Add three teams, one each in:

The Coastal Pacific (AK, HI, WA, OR) – Portland is the obvious site based on size.

California – Riverside is the largest metro area without a team at this point, so it’s time for the Inland Empire to join the NFL.

The Atlantic South (NC, SC, GA) – Yep, another one.  This area is growing fast.  Columbia, SC, barely beats out Greensboro, NC for this coveted franchise.

2050 – Add four more teams, one each in:

Texas – At this point Texas will have five teams.  Fort Worth still deserves it if they want to part ways with the Cowboys, but if not, the team goes to El Paso.

The desert SW (NV, UT, AZ, NM) – It’s time for Salt Lake to get a clean-living team.  Perhaps they could play in the same division as the Las Vegas franchise?

The Atlantic South (NC, SC, GA) – Would you believe a third team in North Carolina?  If they can pull it off, Greensboro gets this team.

The Tropical South (FL, Puerto Rico) – San Juan, Puerto Rico, would be first in line. If you think the team must be in a state and not a territory, then it would go to Orlando, but maybe Puerto Rico will be a state by 2050 anyway.

Now, if you don’t think that Puerto Rico’s population should be included since it’s not technically a state, the last team would go NOT to the Tropical South, but up north in New England, where it would likely be awarded to Providence, Rhode Island. However, let’s assume that San Juan gets it.

So over the next 40 years, we would add 14 new teams:

Three in Texas:  San Antonio, Austin, and either Forth Worth or El Paso

Three in the Carolinas:  Raleigh, Columbia, and Greensboro

Two in California – Los Angeles and Riverside

Two in the Desert Southwest:  Las Vegas and Salt Lake City

One in the Great Plains – Oklahoma City

One in the Deep South:  Birmingham

One in the Coastal Pacific:  Portland

One in the Tropical South:  San Juan or perhaps Orlando


What do you think about this future?  Would you change your favorite team?  Or will you grouse about how the talent pool is being diluted?  We think the smart money is to start putting an ownership team together in Oklahoma City or Birmingham.

Read the first blog in this two part blog series on the expansion of the NFL.