Tag: Polly Karpowicz

Being Responsible About Research

Posted on | by Elizabeth Weaver Engel, CAE

In this final post celebrating the launch of Caveat Emptor: Becoming a Responsible Consumer of Research, I want to talk about why this matters.

Why do association execs need to develop discernment about research, both as consumers and sponsors? Why do you need to have at least some familiarity with research terms? Why do you need to understand the benefits and drawbacks of various types of research methods?

Quoting from the monograph:

It’s important for associations to get this right, both so that association executives have the best possible chance of making good decisions about how to invest limited association resources to generate the best return for members, and because associations are viewed as trusted, unbiased sources of information for the members and other audiences we serve. It’s incumbent on us to provide quality research products so we remain worthy of that trust.

As a reminder, the whitepaper also includes:

  • An interview with Dr. Sharon E. Moss, co-editor (with Sarah C. Slater) of The Informed Association: A Practical Guide to Using Research for Results, on ethical practices in research.
  • An interview with Dr. Joyce E. A. Russell, The Helen and William O’Toole Dean at Villanova School of Business, on developing discernment in assessing research.
  • An interview with Jeff Tenenbaum, Managing Partner at Tenenbaum Law Group PLLC, on avoiding antitrust liability.
  • Case studies with the American Association of Colleges of Pharmacy, the Association of American Medical Colleges, the Casualty Actuarial Society, and IEEE.
  • A plain English review of key research terms, and a brief explanation of the rules of formal logic (and how they affect research work).
  • Recommendations for books, articles, websites, podcasts, and courses you can use to improve your research skills.
  • A series of thought questions for you to use to spark discussion with your team.
  • An extensive list of resources in case you want to dig deeper on any of the topics addressed.

My co-author Polly Karpowicz and I are in the process of arranging additional opportunities to learn more, including a webinar with Association Insights in Old Town in April of 2023 – more information to follow.

In the meantime, get your free copy at https://bit.ly/3SYJiAO, no divulging of information about yourself required.

 

Curiosity with a Purpose

Posted on | by Elizabeth Weaver Engel, CAE

As Zora Neale Hurston described it:

Research is formalized curiosity. It is poking and prying with a purpose.

When you’re sponsoring a research study, one of the biggest decisions you’ll have to make is what method(s) to use.

What are your choices?

  • Quantitative v. Qualitative
  • Primary v. Secondary

You also have some decisions to make about data collection. The choices there include:

  • Formal v. Informal
  • Active v. Passive

All of these choices have associated pros and cons.

For instance, surveys (quantitative primary research where the data collection is active and formal) provide numeric answers that can be described by levels of statistical significance and degrees of confidence (see yesterday’s post for more on that). That’s obviously a pro.

On the con side, because surveys provide reassuringly specific answers, it’s tempting to over-rely on them. They’re also more susceptible to design flaws that can introduce bias – and once the survey’s deployed, you can’t correct those errors without invalidating all the responses that have already come in.

So what’s the answer?

Download the new Spark collaborative whitepaper Caveat Emptor: Becoming a Responsible Consumer of Research to find out!

“P-Value”? What’s a “P-Value”?

Posted on | by Elizabeth Weaver Engel, CAE | 1 Comment on “P-Value”? What’s a “P-Value”?

And why should you care?

Associations generate a lot of original research, but association execs also use a lot of research created by other entities both to assess the internal operations of the association as a tax-exempt business and to understand what’s happening in the industry or profession the association serves.

And let’s face it: Lots of research terms are pretty jargon-y. P-values and margin of error and confidence interval and representative versus purposeful samples, oh my!

It’s easy to find yourself glazing over in the methods section of the study you’ve chosen, ignoring it all together, or just deciding not to worry about what it reports.

That would be a mistake.

All those things directly affect the validity of the study and the results presented, results which we use every day to make decisions for our associations and the professions and industries we serve.

Quoting the new Spark collaborative whitepaper Caveat Emptor: Becoming a Responsible Consumer of Research:

Good research does not guarantee good decisions, but it certainly helps. And bad research, barring getting lucky and guessing right, almost inevitably leads to bad decisions.

We want you to have everything you need to make good decisions, so in Caveat Emptor, my co-author Polly Karpowicz and I provide plain English explanations of key terms in research design so that you can build your information literacy muscles and choose wisely what research you will – and won’t – trust.

Get your free copy at https://bit.ly/3SYJiAO, no divulging of information about yourself required.

 

Lies, Damn Lies & Statistics?

Posted on | by Elizabeth Weaver Engel, CAE

Association execs consume – and produce – a lot of research in our day-to-day work, but most of us don’t have formal training in research. A lot of the language of research programs– p-values and confidence intervals and margins of error – can be pretty jargony, and some of the concepts behind what makes for good (or less good) research can be challenging for people who haven’t had the opportunity to take a graduate level methods course.

How can you be sure that the research you’re using or sponsoring is giving you the insight you need to make good decisions? How can you protect your association’s reputation as a trusted source of unbiased information for the profession or industry you serve?

In the latest Spark collaborative whitepaper, Caveat Emptor: Becoming a Responsible Consumer of Research, Polly Karpowicz, CAE and I tackle the sometimes thorny issue of what you need to know to be a savvy consumer and sponsor of research even if you DON’T have a formal background in research methods or much formal training (which, let’s be honest, most of us don’t).

The whitepaper also includes:

  • An interview with Dr. Sharon E. Moss, co-editor (with Sarah C. Slater) of The Informed Association: A Practical Guide to Using Research for Results, on ethical practices in research.
  • An interview with Dr. Joyce E. A. Russell, The Helen and William O’Toole Dean at Villanova School of Business, on developing discernment in assessing research.
  • An interview with Jeff Tenenbaum, Managing Partner at Tenenbaum Law Group PLLC, on avoiding antitrust liability.
  • Case studies with the American Association of Colleges of Pharmacy, the Association of American Medical Colleges, the Casualty Actuarial Society, and IEEE.
  • A plain English review of key research terms, and a brief explanation of the rules of formal logic (and how they affect research work).
  • Recommendations for books, articles, websites, podcasts, and courses you can use to improve your research skills.
  • A series of thought questions for you to use to spark discussion with your team.
  • An extensive list of resources in case you want to dig deeper on any of the topics addressed.

I’ll be blogging about the whitepaper more in the coming days, highlighting some of our major findings, but in the meantime I invite you to download your free copy at https://bit.ly/3SYJiAO – we don’t collect any data on you to get it, and you won’t end up on some mailing list you didn’t ask for. We just use the bit.ly as an easy mechanism to count the number of times it’s been downloaded.

And don’t forget to check out some of the other FREE Spark collaborative whitepapers, too, on topics ranging from content curation to digital transformation, blockchain, DEI, lean startup, member-centric engagement, and more!

Happy Fabulous Five, Spark!

Posted on | by Elizabeth Weaver Engel, CAE
Floral design - Flower

Today marks five years since I launched Spark Consulting. As I look back on the past five years, I have much to be grateful for. Leading that list is all the people who’ve contributed to the success of this Big Hairy Audacious Goal.

First, I have to thank all my wonderful clients. Spark would not exist without each and every one of you. I particularly want to thank the American Chemical Society, my very first client, for being willing to take a risk on hiring the new kid in town, and Ross Simons for making the connection between a brand-new consultant and her first lead. Over the years, many of my clients have referred me to their colleagues and/or hired me again for additional projects. I can’t express how grateful I am for their confidence in me and my work.

Back in late 2011, I was working for the Children’s Hospitals Association. I’d been there for a few years and was starting to think about my next move. At the time, I was thinking it would be my first CEO position, leading a small association. I’d been in the biz for 14 years at that point, had my CAE and an MA, had worked in a wide variety of functional areas in association management leading a variety of different types and sizes of teams, and had even served as an acting CEO for a small association. I started applying for those types of positions, despite the fact that when I mentioned I was looking for my next gig, the nearly universal response was, “So you’re launching your own consulting business, right?” I want to thank Shira Harrington (Purposeful Hire) for being the one who helped me understand that being a consultant would be a better path for me.

Maddie Grant, Lindy Dreyer, and Jamie Notter came over to my house on a cold winter afternoon and helped me figure out what I wanted to call this new consulting business, how I wanted to frame the work I wanted to do, how brand Spark and myself, and brainstormed my clever URL (in which a discussion about “GetMeJamieNotter” led to “GetMeSpark”).

When I was starting out, I was fortunate to be invited to join a Mastermind Group that served as my kitchen cabinet, pushed me to define my goals, and helped me think through how to overcome the barriers to achieving them. Leslie White, Peggy Hoffman, Shira Harrington, KiKi L’Italien, and Sohini Baliga kept me on the right path during those critical first two years.

One of the most useful things I learned studying for the CAE 14 years ago was to know what you are – and aren’t – good at, and make sure to surround yourself with great people who know and can do what you can’t. I’ve been fortunate to work with four outstanding vendors on the tasks I can’t do for myself: Bean Creative for my website, ImagePrep for all my graphic design needs, Andrew Mirsky (Mirsky Law Group) for all my contracts and other legal needs, and Moran & Company for bookkeeping, accounting, and tax advice and planning.

My original career goal, back in college, was to be a university professor. I’ve always loved research and writing, particularly long-form essays. One of the most personally and professionally fulfilling things I’ve been able to do since launching Spark is the Spark collaborative white paper series. I now have the freedom to research and write, diving into topics that interest me and that I think are important for our industry.

I’ve been fortunate to work with a host of fantastic contributors for the nine existing monographs: Jeff De Cagna, George Breeden, Tom Lehman, Jamie Notter, Leslie White, Peggy Hoffman, Peter Houstle, Anna Caraveli, Guillermo Ortiz de Zarate, Shelly Alcorn, Polly Siobhan Karpowicz, Tracy Petrillo, Sherry Marts, Joe Gerstandt, Jess Pettitt, and Joan Eisenstodt.

I also want to thank the many association executives who were willing to share the stories of their organizations’ work, struggles, and triumphs in the case studies that illustrate many of the concepts the white papers discuss.

Thanks also go to Alison Dixon (Image Prep), who’s done all the beautiful layout and graphic work on the white papers, and to copy editors Ed Lamb and Joe Rominiecki, who’ve done their level best to save me from my typos and grammatical errors.

The association consulting community more broadly has also served as a tremendous source of inspiration, help, and advice over the years. Many association consultants have generously given of their time and expertise to answer my questions, point me in the direction of resources I need, or just generally help me to buck up when things aren’t going as I’d like them to with the business. We may be competitors, at least on occasion, but we are a community and we help each other out, and that’s priceless.

Finally, and perhaps most importantly, I have to thank my spouse, Jim. When I came home from that fateful lunch with Shira nearly six years ago, I was nervous. As far as he knew, the plan was to land a CEO position, with the attendant salary, benefits, and security. I knew I was about to announce that I might want to throw all that over in favor of the risk, excitement, and uncertainty of launching my own business. This change in direction would have a dramatic effect on him and his life as well, and I didn’t know how he’d respond.

When I told him what had happened over lunch and what I was thinking, he responded: “I think that’s a great idea. I think you’d be a terrific solo consultant. You should definitely do that.”

“Well damn,” I thought. “If he’s that confident, what in the hell am I so worried about?”

Five years later, here we are. It’s been a thrilling, challenging, amazing, terrifying journey so far. I can’t wait to see what the next five years bring.

Photo by Peedee on Unsplash