“How do you use this thing?” Apps and Usability

Dr. Schueller is the Executive Director of PsyberGuide and an Assistant Professor at Northwestern University’s Feinberg School of Medicine. He is a faculty member of Northwestern’s Center for Behavioral Intervention Technologies (CBITs) and his work focuses on increasing the accessibility and availability of mental health resources through technology.

Although many researchers and academics have decried the lack of scientific evidence for many mobile apps available on the public app stores, fewer have brought up the glaring usability issues of such resources. Usability refers to how easy an app is to use. In order for a mobile health app to be useful, it must first be usable. Usability testing, that is the analysis of how well users can learn and use a product to achieve their goals and how satisfied users are with that process, has a long history in the development and evaluation of technologies. Engineers, computer scientists, and human-computer interaction specialists usually consider usability guidelines in their designs and evaluate usability as a first step in the evaluation of novel technologies. Usability testing is less frequently used in by clinical psychologists or behavioral scientists conducting research on mobile mental health apps, who often jump to evaluations of whether apps lead to intended changes in clinical outcomes (e.g., less depressed or anxious, increased well-being). Therefore, we often learn whether or not an app can be effective, without knowing how easy it is for people to use it on their own. Usability is captured in “Functionality” score on the Mobile App Rating Scale (MARS) that PsyberGuide uses to rate products listed on our site. Functionality on the MARS refers to the functioning, ease of use, navigation, flow logic, and gestural design of the app.

A recent study explored the usability of 4 mental health apps (Depression CBT, Mood Tools, Optimism, and T2 MoodTracker).1 Twenty-six patients were invited into the laboratory to complete a series of tasks on these apps and researchers watched, videotaped, and questioned participants to learn more about the usability of these apps. These tasks included data entry tasks such as entering one’s mood or taking a depression test and data retrieval tasks such as viewing a graph or watching a video. Only 51% of the time were participants able to complete the data entry tasks without assistance. Data retrieval tasks were even more challenging at 43%. Participants reported that their experiences with these apps were frustrating and instilled a lack of confidence that such tools could then be helpful for them. Not an extremely positive review of the usability of these apps.

I bring up these results as a word of warning both to those developing mobile health apps and those using mobile health apps. Developers, we can and should do better. Mobile health apps should be easy to use for a wide range of the people. The authors of this paper offered the following advice: (1) explain why each task is helpful, (2) use simple language and graphics, (3) reduce the number of screens, and (4) reduce manual entry as much as possible. And for those who want to use mobile health apps, this is one reason we provide multiple ratings of mental health apps on our website. PsyberGuide ratings address the credibility of a product. MARS ratings combine several aspects of an app, including its functionality. Lastly, expert reviews provide detailed information about why and how an app might be beneficial for you. An app might have a lot of research support, and thus a high PsyberGuide rating, but low scores for engagement, functionality, and aesthetics and thus a low MARS score. Usability and functionality might be a more important aspect for particular people. For designers, we need to better understand the capacities of the people we’re designing for. For users, it’s helpful to have a sense of your own capabilities with mobile technology and to select an app that best fits with those capabilities. If you’re having trouble using a mobile app, you’re not alone and it might be useful to run it by someone you trust – a doctor, family member, friend, to see if they can help you figure it out. And remember that for you to benefit from a mobile app, you need to use it, and one of our tasks at PsyberGuide is to help you find which apps are most usable.

  1. Sarkar, U., Gourley, G. I., Lyles, C. R., Tieu, L., Clarity, C., Newmark, L., … & Bates, D. W. (2016). Usability of commercially available mobile applications for diverse patients. Journal of general internal medicine31(12), 1417-1426. https://www.ncbi.nlm.nih.gov/pubmed/27418347





What Can Tooth Brushing Teach Us About Behavior Change in the Era of Digital Health?

by John Torous

John Torous MD is a board certified psychiatrist who has a background in computer science.  He co-directs the Beth Israel Deaconess Medical Center’s digital psychiatry program, www.psych.digital, where he also serves as a staff psychiatrist and a clinical informatics fellow. He also serves as the Editor-in-Chief of JMIR Mental Health. You can                                                                        follow him on Twitter @JohnTorousMD

All health apps, including mental health apps, experience a serious engagement problem. A large observational study of an asthma-monitoring app [1], real world users of an app for post traumatic stress disorder, PTSD Coach [2], and even the popular gamified physical activity app Pokémon GO [3] all show the same pattern. Many users download the app, most use it a few times, but few persist after a few weeks. In short, despite people’s strong interest in using health apps, few people stick with them.

It is useful to check our assumptions about ideal engagement against other healthy behavioral patterns. Take tooth brushing for example. This is healthy habit that seems routine and ubiquitous. The American Dental Association recommends that people brush their teeth twice a twice. What can tooth brushing teach us about helping people stick with health apps?

A first step is to check the data.  Apparently only 69% of Americans brush their teeth twice per day [4]. That means nearly one third are not able to stick with this simple healthy habit! If nothing else, this shows how challenging behavior change is, there are no ‘easy wins.’ But looking at the bright side, 69% is large amount of the population. What can these people teach us about success? What helps them stick with twice-daily tooth brushing? While there are of course many factors, one of the most common is that it is fast and part of their daily routine.

Mental health apps can learn from this. Brushing your teeth takes about two minute – but how long does it take to use most mental health apps. Many apps offer lessons drawn from traditional face-to-face therapies that take users hours to read! Others create entire digital ecosystems that take hours to master and significant time to navigate. What if mental health apps could be simpler and faster to use? A recent study by Dr. David Mohr and the IntelliCare team, including Stephen Schueller, PsyberGuide’s Executive Director, explored if a suite of mental health apps called IntelliCare designed for ultra brief use sessions would be engaging and effective. [5]. Findings showed that usage of the apps followed from this design consideration. App sessions averaged 1.1 minutes and people used the apps an average of 3.5 times per day. Furthermore, people experienced significant reductions in depression and anxiety with over three-fourths of people either in full remission or recovery after 8 weeks. The results of the study suggest that these ultra brief  apps were indeed both effective and engaging – highlighting a new paradigm for mental health apps – and perhaps all health apps.

Apps have much to offer mental health, but there is still much that apps must improve on to be more effective mental health tools. The IntelliCare study offers an encouraging solution to engagement. You can learn more about IntelliCare and find where to download here.

Trivia: What percent brush their teeth while driving: 0.2%. What percent of teen have used their smartphone while driving: 80%.

  1. Chan YF, Wang P, Rogers L, Tignor N, Zweig M, Hershman SG, Genes N, Scott ER, Krock E, Badgeley M, Edgar R. The Asthma Mobile Health Study, a large-scale clinical observational study using ResearchKit. Nature Biotechnology. 2017 Apr 1;35(4):354-62.
  2. Owen JE, Jaworski BK, Kuhn E, Makin-Byrd KN, Ramsey KM, Hoffman JE. mHealth in the wild: using novel data to examine the reach, use, and impact of PTSD coach. JMIR mental health. 2015;2(1):e7.
  3. https://medium.com/achievemint/can-augmented-reality-alter-reality-quantifying-the-pok%C3%A9mon-go-effect-561bf996d4b9
  4. https://www.deltadental.com/Public/NewsMedia/NewsReleaseDentalSurveyFindsShortcomings_201409.jsp
  5. Mohr DC, Tomasino KN, Lattie EG, Palac HL, Kwasny MJ, Weingardt K, Karr CJ, Kaiser SM, Rossom RC, Bardsley LR, Caccamo L. IntelliCare: An Eclectic, Skills-Based App Suite for the Treatment of Depression and Anxiety. Journal of Medical Internet Research. 2017;19(1):e10.


Can apps reduce anxiety?

Dr. Schueller is the Executive Director of PsyberGuide and an Assistant Professor at Northwestern University’s Feinberg School of Medicine. He is a faculty member of Northwestern’s Center for Behavioral Intervention Technologies (CBITs) and his work focuses on increasing the accessibility and availability of mental health resources through technology.

A recent meta-analysis by Joseph Firth and colleagues [1] explored whether the scientific evidence supports that smartphone apps can reduce symptoms of anxiety. Meta-analyses are often considered one of the most useful forms of scientific information because they combine the results of several studies to produce a more powerful investigation than any single study could provide. The findings of Firth and colleagues meta-analysis suggest that smartphone apps were an effective form of treatment for anxiety, although the size of the impact is what researchers would call small-to-moderate. That means, that we can reliably say that smartphone apps designed to decrease anxiety can do so, but that the impact would be less than one would expect with the gold standard face-to-face treatments or medications. This is not surprising, the dose of “treatment” from these smartphone apps was much shorter than what one would typically receive in terms of face-to-face treatment or medications, ranging from 4 to 10 weeks with an average of 6.1 weeks.

It is useful to dig into this meta-analysis a little more deeply as it tells us what we know (and don’t know) about the effectiveness of smartphone apps for anxiety and some of the limitations of the current research. First, the authors identified only 9 eligible studies that collectively represented 1837 total participants. There are many more than 9 apps targeting anxiety available in the Google Play and Apple iTunes store, which again shows that most of the apps available have no direct scientific evidence confirming their effectiveness. Conversely though, only 4 of the apps are currently available in those app marketplaces (Flowy, myCompass, SuperBetter, and components of the LivingSMART intervention which consisted of non-mental health apps such as Google Calendar, Evernote, Stayfocusd or SimplyNoise with instructions on how they could be applicable for mental health issues). We currently only have SuperBetter listed on PsyberGuide, along with an expert review, but will work to get these other resources listed in the near future. The 1837 people included in this meta-analysis likely represents a small portion of the total number of people with anxiety who have downloaded a mental health app. It is impossible to know how well these 1837 people represent people who download apps for anxiety more generally. These people tended to be adults, average age of 36.1 years, women (65.2%), and no study used a diagnosed anxiety disorder as a criterion for inclusion. Therefore, it’s hard to say how well apps would work for adolescents or older adults, men, or people with more severe anxiety.

The most impactful apps were those that were included along with some other treatment either face-to-face or Internet-based therapy programs. This is an important caution that for many people, apps alone are unlikely to be a sufficient treatment. If you’re not currently receiving treatment, an app can be a good way to introduce you to important treatment skills like deep breathing, exposure, goal setting, or self-monitoring. If you’re in treatment, apps can help support the work you are currently doing, although it might be useful to discuss with your provider for suggestions or which skills or apps might be the most useful. And lastly, if you’ve received treatment in the past, apps can help reinforce the work you’ve done or to keep up with some of the skills you’ve learned. If you use an app and don’t feel like you’re getting better that doesn’t mean you’re beyond help, it might be that you haven’t found the right app or that it would work better for you in combination with something else.

Thus, although this meta-analysis is a useful summary of the current research evidence, it illustrates the need for additional information: evidence produced by researchers on the efficacy of such apps, evidence gained from consumers on the effectiveness of such apps, and evidence from experts, like that provided in PsyberGuide, to better guide decisions regarding the usefulness of smartphone apps for anxiety. The findings provide enthusiasm that smartphone apps can work but more information is needed about which ones, for whom, and how people can get the most benefits out of such resources.

1. Joseph Firth, John Torous, Jennifer Nicholas, Rebekah Carney, Simon Rosenbaum, and Jerome Sarris. Can smartphone mental health interventions reduce symptoms of anxiety? A
meta-analysis of randomized controlled trials. Journal of Affective Disorders, 218, 15-22.




Welcome to PsyberGuide, a pioneering Digital Apothecary!

by Ricardo F. Muñoz

Dr. Muñoz is the Founding Director of the Institute for International Internet Interventions for Health (i4Health; http://i4health.paloaltou.edu/) and Distinguished Professor of Clinical Psychology at Palo Alto University (https://www.paloaltou.edu/).  He is also Professor Emeritus at the University of California, San Francisco and Adjunct Clinical Professor at Stanford University.

“Is this a good time to talk?”

It’s the year 2025.  Your digital assistant has just pinged you.  For a few days now, you have been feeling a lack of energy that is different from the usual fatigue when you have been working hard, or the boredom that you have felt from time to time. You just finished talking to one of your friends on your latest mobile device, and, as soon as the conversation ended, your digital assistant inquired if you are available to chat.

It informs you that, according to the health app you activated when you set up your device, your voice tone during the few conversations you’ve had over the last week indicates that your mood level has been unusually low for you. Does that ring true?  And, if so, would you like to do something about it now?

You say “Yeah, what have you got?”  And your digital assistant immediately connects you to the pages in PsyberGuide that list the apps on depression prevention.  There are several depression prevention apps. In addition to the PsyberGuide research rating, the Mobile App Rating Scale, and the expert review, you can also click on a button that says “Drill down.”   You click on the button. 

The apps are then grouped into three categories:  Adjuncts, Guided apps, and Automated apps. Adjuncts are intended to be used as add-ons to regular treatment with a licensed psychotherapist or pharmacotherapist.  Guided apps provide live lay assistance via phone, chat, email, or text messaging, to help the user stay with the program (most users have a hard time completing totally self-help programs).  And Automated apps are intended to be used without any human support. 

You also notice a “Box Score” for many of the apps.  It turns out that some of the apps provide effectiveness data on the fly.  The Box Score shows the proportion of users whose mood levels have decreased significantly after using the app for a week and for a month.  And the data is updated daily.  Clicking on the Box Score provides more data:  The number of people who downloaded the app, who used the app more than once, their ratings, and their outcomes.  You can also drill down and check out outcomes by gender, age, race, ethnicity, education, income, religion, language, and so on, so you can pick the app that has worked best for people like you.

You decide you’d like help from a live therapist.  But your digital assistant informs you that your small town does not have mental health providers.  The nearest one is two hours away.  You decide you’ll try one of the guided apps.  But, you see that most of the best-rated apps involve a fee.  So, you decide to begin with the best-rated free automated app.  And you get started…

Welcome to the future.   PsyberGuide is one of the first Digital Apothecaries and thus has the potential to become the premier one going forward.  It already takes into account expert ratings and is starting to obtain consumer ratings.  Perhaps it will eventually add some of the features that I describe in my time travel fantasy.

We tend to think of the future as a modification of the present.  But this constrains us unnecessarily.  Our health care practices were developed at a time when in-person care was the only option, when people sought help only when they were hurting, when most health care required payment.  Minor modifications to this individually-focused practice will not reduce the burden of disease at the population level.  We need to redesign our health care systems with global health in mind.

There is now research evidence that we can prevent half of the new episodes of major depression in persons at risk.  Why wait until people are clinically depressed to teach them the mood management skills that will avert a full-blown episode?  There is research evidence that we can provide these preventive interventions online.  And there are proof-of-concept projects that show that it is feasible to provide interventions for such issues as depression and smoking to people all over the world at no charge to them.  This can be done by using digital tools that have been developed and tested with research grants and, after the grant ends, making them accessible to anyone in the world who wants to use them.  We have called these “Massive Open Online Interventions” (MOOIs, pronounced MOO-ees), inspired by MOOCs (Massive Open Online Courses).

We need to develop business models that will allow for sustainability of MOOIs that are free and open to all.  For example, we could create links from MOOIs to companies that provide guided help for a fee.  Those companies could then pay a referral fee to the group hosting the MOOI.  This revenue stream would help pay for ongoing hosting expenses and, ideally, for continuing development and testing of the MOOI, so that outcomes for the fully automated version continue to improve.

I wish PsyberGuide a long, successful, and influential life.  May it contribute to the dream of making health care a human right.



Finding an App That’ll Work for You: Building the PsyberGuide Community

Dr. Schueller is the Executive Director of PsyberGuide and an Assistant Professor at Northwestern University’s Feinberg School of Medicine. He is a faculty member of Northwestern’s Center for Behavioral Intervention Technologies (CBITs) and his work focuses on increasing the accessibility and availability of mental health resources through technology.

It is with great pleasure that I write the first Director’s Blog for PsyberGuide. PsyberGuide aims to be the leading source of unbiased information regarding technologies intended to address mental disorders – e.g., depression, anxiety, bipolar, and schizophrenia – and to promote mental health. This is hardly an easy task. The number of mHealth apps exceeds 165,000 with estimates that roughly 12,000 of those are targeted towards mental health and wellness. Very few of these apps have been subjected to rigorous scientific evaluation, and those that have don’t often persist in the app stores. As a consumer sorting through these apps and separating the good from the bad is a nearly impossible task. As such, resources like PsyberGuide have an important role to play in ensuring that people can find the apps that might be the most beneficial for them and understanding what role those apps can play on each person’s own road to recovery. An important goal of mine with PsyberGuide is to continue to grow the number of products and reviews listed on this website. I encourage you to keep coming back to PsyberGuide to see what new apps we’ve identified and the ratings and expert reviews associated with those apps. If there’s an app you’ve found that’s been particularly useful, please let us know which app it is and why and how you’ve found it useful.

This relates to another critical point. It is unlikely that there is one app to rule them all, or said differently that any app will work for all people. The struggles that people encounter with mental health can often be deeply personal. And although our destinations might be the same – finding happiness, meaning, and purpose; building positive relationships; and achieving our goals and dreams – the roads we take to reach those destinations might differ. To better understand these differences, however, we need to hear from the people using these apps in their lives, we need to hear from you. Another goal for PsyberGuide is to connect the communities of interest – consumers, professionals, researchers. In the past, we’ve done this by providing experts ratings and reviews of available mental health apps. We’d also like to learn from your expertise and experience with these tools. We’d love to have more information from people who use mental health apps about which ones are useful and why. Currently in the product guide you can provide some of this information: how likely you would be to recommend the app to others, how effective the app was in helping with problems, how easy to use and engaging the app is. We’d like to make more use of this information to help point us towards the most popular, useful, and engaging apps. We’d also like to expand this information, to better design PsyberGuide to collect the information needed to not just provide scores of products, but to start to make recommendations to guide you towards what might be useful apps for you.

None of this can happen without you. I am excited to lead PsyberGuide because I truly believe that technology and digital resources have a critical, yet unrealized, role to play in mental healthcare. I believe that technology and digital resources have the potential to ensure that all people who need mental health resources will have access to them and that those who might prefer technology or digital resources for a variety of different resources will be empowered to find ones that are high-quality and effective. These Director’s Blogs will give me one avenue to communicate with the PsyberGuide community. But we’ll also find other ways to connect. For example, through emails, newsletters, social media, and events. We’ll also engage the community of experts using guest blogs which will alternate with the blogs I write myself. Again, PsyberGuide will be a resource where multiple voices come together to identify the state-of-the-art advances in mental health and technology. This is an exciting partnership, and I’m extremely curious to see where we go together.




Comment on: “Computerized cognitive behavior therapy (cCBT) as treatment for depression in primary care (REEACT trial): large scale pragmatic randomized controlled trial”, Gilbody S et al, British Medical Journal BMJ 2015;351:h5627

This is an important study that sought to evaluate cCBT for the treatment of depression in primary care settings. The study was conducted in the United Kingdom, where cCBT has been promoted and reimbursed by the National Health Service since 2006. Depression is a common illness and most patients are treated by primary care physicians rather than specialists. Antidepressants are frequently offered to patients, but access to psychotherapy and other forms of treatment for depression is often quite limited.

Previous studies of cCBT tend to support the efficacy of this intervention, however these studies have been criticized for having small sample sizes, highly selected participants (in that they may be from academic settings and screened for complicating factors that are common in the “real world”), and for lack of bias (in that they are often supported by companies with a commercial interest in the outcome).

The REEACT study was a “real world” study conducted at large primary care practices in various parts of the United Kingdom.  Patients with depression were randomized to receive: usual care from primary care physicians, usual care supplemented by a commercial cCBT (Beating the Blues) or usual care supplemented by a “free to use” cCBT (MoodGYM). Incidentally, both Beating the Blues and MoodGYM have been reviewed favorably by PsyberGuide. Follow-up data were collected at 4, 12 and 24 months after randomization. Patients assigned to cCBT received weekly support phone calls from trained technicians.

After entering the study, follow-up data were obtained for 76% at 4 months, 70% at 12 months, and 67% at 24 months. Thus, almost one quarter of the subjects had dropped out by 4 months. At four months, 50% of people using Beating the Blues, 49% of people using MoodGYM and 44% receiving usual care were still depressed. Therefore, the authors concluded that there was no demonstrable benefit for any of the three treatment arms. There also did not appear to be differences at 12 and 24 months. Most interestingly, the median number of sessions completed for Beating the Blues was 2, and for MoodGYM was 1. Only 18% of patients completed all 8 sessions of Beating the Blues and only 16% completed all 6 sessions of MoodGYM.

The authors conclude that cCBT programs appear to be effective when they are led by developers but do not appear to be effective in an independent study in a standard primary care setting. They believe that the main reasons for the negative study were low adherence and engagement rather than lack of efficacy.

This study raises several questions for me:

  1. Can depression be treated reliably in primary care settings? I think “high contact” specialty care will be necessary for most patients with significant depression.
  2. Can we develop computer programs that are engaging enough to overcome the inertia and lack of motivation that are part of depressive illnesses?
  3. If “high contact” care is needed for patients with major depression, can therapies delivered on-line (such as tele-psychiatry or on-line social networks of support) solve our access to care issues and be more effective than cCBT?

Wellocracy – Tracking for Health

As researchers and developers increasingly tout the potential benefits of health-related apps and wearables, the large number of options available to consumers can make the job of choosing between them nearly impossible. While PsyberGuide surveys the field of products that address mental health concerns, a group of scientists at Brigham and Women’s Hospital and Massachusetts General Hospital have created Wellocracy, a consumer-oriented website reviewing tracking apps and devices that focus on physical health and wellness.

When it comes to apps and wearables, “tracking” relates to the collection and analysis of data about daily health-related activities such as exercise or diet. The idea is that this information can be used to give feedback to the user or to medical providers and researchers in order to improve physical health at both individual and community levels. Wellocracy focuses on nine categories of products that provide this service:

  • Wearable Devices
  • Running Apps
  • Pedometer Apps
  • Sleep Apps and Devices
  • Mood Apps
  • Food and Calorie Apps
  • Heart Health Apps and Devices
  • Connected Scales
  • Healthy Habit Apps

An excellent feature of Wellocracy is that products in each category are compared side-by-side to make it easy to determine which fits best into the user’s lifestyle. To help with this decision-making process, the site includes a useful questionnaire of potential health/wellness goals and problem areas in order to generate individually-tailored suggestions. In addition, Wellocracy provides basic information about tracking and how making it a regular part of a daily schedule can lead to a better life.

Wellocracy holds a lot of promise in the growing field of tracking apps and wearables. As scientists at renowned research hospitals, the group behind Wellocracy is in a unique position to study the current crop of products and offer reliable data about which can be most helpful. We at PsyberGuide think that anyone who is interested in tracking for health should make a visit to Wellocracy the starting point in their search.

Why making good apps is hard: Part 1

At PsyberGuide, our goal is to evaluate apps from all perspectives. It is critical that an app has a sound science-based approach toward improving mental health, but it is also critical that an app is not frustrating to use – it is fast, responsive, doesn’t crash, and avoids all of the other common frustrations for users.

Over the next few weeks, we’ll write about some of the difficulties facing app manufacturers in trying to make and maintain apps that perform well. The first difficulty we are going to look at is the constant need for updating an app.

There are several reasons why apps need to be updated:

  • Adding new features
    Products need to frequently add new features, to keep up with competitors and to keep the interest of users
  • Expanding capacities
    Such as adding support for other languages, or extending the app for new smartwatches
  • Responding to updates in the platform
    IOS, Android, and Windows platforms are frequently updated. Apps need to perform well in the updated environment and take advantage of the new features of that environment. They also need to still work well on older versions of the platforms, since many users do not update to the current versions of the platform.
  • Fixing bugs
    Bugs inevitably occur in the products, especially given the quick timeframe in which new versions of the app are produced

Let’s look at two very popular apps – Lumosity and Headspace. Both of these products are considered mature apps – they have been around for several years and are feature-rich and well-tested. And yet this doesn’t mean that they don’t have to keep continuously updating. Recent updates include:

Lumosity: 18 new IOS versions in 2015
Headspace: 8 new IOS versions in 2015

This is just for the Apple IOS platform and just for 2015. Most apps are also frequently updating an Android version and a web version of the product, multiplying the amount of work.

The need for constant updates means that apps have to have access to significant funding.   Some of the apps on PsyberGuide have institutional financing, and many other apps rely on equity funding and growing a large user base. Lumosity and Headspace both use the popular model of offering a limited version of the product for free, and then charging subscription fees for more content. It is likely that they have a large enough user base that they can afford to keep constantly updating their apps in the future. Many other apps may have more difficulty finding the money for updates.

Brain Futures conference

BrainFutures 2015: Exploring New Frontiers to Improve Brain Health & Optimize the Mind’s Potential is an upcoming conference that will cover many of the new developments in brain technologies and neuroscience. There is also a BrainFutures Expo with hands-on access to new technologies.

Hosted by the Mental Health Association of Maryland, the conference is  November 4-5, 2015 in Annapolis, Maryland.  Information and registration for the conference.

Dr. Michael Knable of PsyberGuide is one of the speakers at the conference.  In a recent program on Maryland’s NPR affiliate station previewing the conference, Dr. Knable talks about reviewing mental health software and the issues around the customer benefits and patient safety.  Henry Harbin and Jay Lombard, two of the other speakers at the conference, are also interviewed.  Audio of the presentation is here.


The state of bi-polar apps

I recently came across a very interesting paper that I think points out the timely need for PsyberGuide and its mission to objectively review apps for mental illness. The paper is entitled: “Mobile Apps for Bipolar Disorder: A Systematic Review of Features and Content Quality,” published in the Journal of Medical Internet Research.

The study was conducted by Jennifer Nicholas and her colleagues in Sydney Australia. They attempted to identify all English apps for bipolar disorder and to check on various aspects of their content. They found 517 apps, 82 of which met their very simple criteria for further review. Of these apps, only 22% had a stated privacy policy, only 36% of the apps that claimed to provide psychoeducation contained the accepted “core principles” of this technique, and only 15% of apps that claimed to provide psychoeducation followed best practice guidelines. None of the apps had been evaluated in a research study and only 31% cited a source for the information they contained. In addition, neither the comprehensiveness of the psychoeducation content, nor the adherence to best practice guidelines, was correlated to user ratings. Finally, many of the symptom monitoring apps failed to measure critical data elements such as medication adherence or sleep patterns.

This article points how easily it might be for users to buy an app that differs widely from accepted standards of care, and which therefore, could potentially lead to harm.