Evaluating the value of blogs: How useful are they for researchers?

Photo credit: Sammby / Adobe Stock

Introduction

We recently completed an evaluation of our own blog. In this post, we present the results of that evaluation and discuss the value of technical blogs in communicating research.
Those working in research communications are likely to know two facts: research is only valuable if it can be communicated well, and communicating effectively is very, very hard. Of all the tools researchers have at their disposal – academic publications, presentations at conferences, forums, and more – blogs stand apart as a unique tool for sharing important knowledge in a more accessible manner. This blog, R&E Search for Evidence, is FHI 360’s tool for this purpose. But does it work? Just as this blog is committed to evidence, we are committed to evaluating the effectiveness of our communication strategies with evidence, so we recently completed an evaluation of our own blog. In this post, we present the results of that evaluation and discuss the value of technical blogs in communicating research and evidence, and the value of blogs to organizations and development professionals.

The R&E Search for Evidence blog started more than seven years ago and currently features 240 posts by 143 FHI 360 staff authors (current and former), covering a wide range of topics across all practice areas at FHI 360. Together, the posts have generated 312,639 page views by 194,322 readers. The blog’s goals are to communicate evidence in a non-academic way, position FHI 360 as a thought leader, and provide professional development opportunities for staff at all levels within the organization.

Methods

The research uses a combination of behavioral, attitudinal, qualitative, and quantitative methods
For our evaluation of the blog, we used a mixed methods approach to evaluate user interest and behavior, internal processes, and strategic positioning of the blog amidst peers. The purpose of this research is threefold: to evaluate how well the blog achieves the goals listed above, assess the sustainability of the blog as a business function, and suggest ways to make the blog more effective.

The research uses a combination of behavioral, attitudinal, qualitative, and quantitative methods (See Figure 1).

 

Evaluation framework and indicators

To evaluate the goals of the blog, we identified seven metrics with seventeen corresponding indicators. The seven metrics are: the audience; user acquisition channels; points of user drop-off or departure; opportunities for greater user acquisition; pathways for deeper and more rewarding user engagement; the blog’s representation of FHI 360’s reputation as a research organization; and how the blog creates a channel for staff to be externally promoted.

Table 1 shows these metrics and the corresponding indicators, as well as the data source for each indicator.

MetricIndicators Source
Audience1. User demographics: age, gender, location
2. Default browser language
3. Device type
Google analytics
Describe user acquisition and departure from the blog
User acquisition channels1. User source by type
2. Social media post traffic / click-rate
Google analytics
Social media analytics
Points of user drop-off or departureuser departure / exit pageGoogle analytics
Opportunities for greater user acquisition1. User acquisition and departure
2. Social media traffic
Google analytics
Pathways for deeper and more rewarding user engagement1. User acquisition and departure
2. Time on site / time per session
3. Site search terms
4. Share rates to social
Google analytics
Social media search
In-page survey
Understand how well the blog achieves its strategic goals
The blog’s representation of FHI 360's reputation as a research organization1. User sentiment analysis
2. Comparison of this blog with blogs from peer organizations
In-page survey Comparative analysis
How the blog creates a channel for staff to be externally promoted1. Staff knowledge of the blog
2. Staff desire to contribute to blog
3. Reflections of staff who have contributed blog posts
Author survey
Focus group of repeat authors
Traffic to author’s social media or websites (google analytics)

Key findings

We learned multiple cross-cutting themes about the value of blogs in communicating research.

Blogs are a critically important tool for communicating research

Across all streams of data collection, it is clear that blogs such as R&E Search for Evidence serve a unique purpose in communicating evidence, one that is unique from publications or other academic fora. Traffic to the R&E search for evidence blog is heaviest to technical or methods-focused pages. The five most popular posts are:

I appreciate that [the blog audience is unique from a research publication], and not necessarily just attached to a peer reviewed article…. There is clearly a very important role for both” (focus group participant)
Focus groups of blog authors unanimously cited their blog posts as serving a different and valuable role compared to publications. Blog posts can be written and published more quickly than a peer-reviewed paper, and they reach a wider audience.

Technical blogs are not unique to FHI 360, either. In analyzing peers in the development sector, we find that most large NGOs and funders have some type of technical blog to communicate science and research. Forums like ABT Global’s “Perspectives”, the Evidence for action “Methods” blog, or 3ie’s “Evidence Matters” are all examples of development experts trying to communicate technical research in more accessible ways. The R&E Search for Evidence blog is similar to peers’ blogs in content, frequency of posts, and communication strategy.

Blogs are an opportunity for early-career professionals to establish their public scientific presence

“Peer review can take a long time and your research findings can sit somewhere unless you go on and present them at a conference or you have like a PowerPoint ready… So I think for me it was a good opportunity to get those [findings] out, especially when it’s something very, very specific and making sure that someone else could use it to sort of like inform whatever it is that we’re doing and also to position ourselves before a conference” (focus group participant)
While peer-reviewed journals are the primary means of establishing an academically-sound reputation, they often have high barriers to entry for young researchers who struggle to be first author, and limit researchers to a scientific writing style. Blogs, however, offer a chance for researchers to articulate their own voice, trading the clinical and dry language in favor of a more relatable and personable tone.

A survey of authors published on the R&E Search for Evidence blog reveals that 76% of authors used their post for disseminating their work – sharing the post via social media, promoting it to peers and colleagues, and adding it to their resume and LinkedIn profiles. Moreover, 20% of the authors used their blog posts for securing speaking engagements, strengthening job applications, and seeking promotions at work.

Authors noted a tension between a highly rigorous process and the speed and informality of publishing blog posts. Focus group respondents also noted that more promotional blogs, project-specific blogs, or opinion-based blogs are faster and easier to publish on, but do not bring as much value to researchers. However, blogs with a high level of rigor and specific focus on communicating research and evidence bring higher recognition and value to the authors but take more time and effort.

Blogs are a valuable tool for NGOs and organizational communications

Lastly, blogs offer a channel for organizations to articulate evidence-based opinions on key issues. By running a technical blog, an organization can synthesize knowledge from their experience, promote a specific practice or approach, and share knowledge with their broader community.

Limitations and ongoing research

This research is limited to qualitative and active feedback from authors; we are still gathering feedback from end-users of the blog, readers like yourself. Surveys on the blog (you may have noticed that bar at the bottom, or box at the end of this post – thank you for your response) aim to solicit more active feedback from readers on their “jobs to be done” and satisfaction with the experience. We have also sent out a survey to subscribers but received minimal responses. This ongoing research will allow us to adapt the blog to users’ needs and expectations.

Conclusions

Blogs are an incredibly valuable tool, and researchers and NGOs should use them more for organizational communication.
Based on this research and our experience, blogs are an incredibly valuable tool, and researchers and NGOs should use them more for organizational communication. A technical blog provides a unique and relatable forum for sharing research findings and reaches a broader audience than scientific publications.

The research clearly shows that blogs also provide an opportunity for early-career professionals, giving a chance for them to express their voice, demonstrate their knowledge on a topic, and begin to create their online presence and digital reputation. This is useful when pursuing career opportunities, seeking funding, or networking.

For organizations that rely on project-based funding, we recommend that proposals and project planning should include resources dedicated to blogs and other thought-leadership pieces; this should not be an afterthought or “nice to have,” but a critical communication and professional development tool. Funders can also suggest or require non-academic forums for research communications to further incentivize this type of work.

Nearly eight years since R&E Search for Evidence was established, we are confident saying that it is a critical tool in research communications and organizational thought-leadership. We at FHI 360 do not want to be unique in this; we hope to see continued and increased use of technical blogs for knowledge sharing and evidence promotion in the development community. These blogs are critical not only for sharing best practices and emerging research, but also for developing professionals in establishing their careers. Lastly, thank you to our readers for your continued engagement and readership, and we hope to keep this content coming.

Sharing is caring!