The reviews are coming in
and the verdict is clear:
Why Nobody Believes the Numbers
is the best book ever written.*
* By me
(Please also see our list of carriers measuring event rates validly in their disease management outcomes calculations)
There are many vendors that “show savings” and there are some vendors that measure validly, but there are only a handful of vendors that show savings (or risk improvement, if wellness) when measured validly: the ones on this list. These are quite literally the only vendors that can get DMPC — or any other organization — to write a Letter of Validation guaranteeing the validity of their savings figures, in which the validating entity itself assumes $10,000 to $100,000 in liability that the savings methodology is sound. Many actuaries and consulting firms will attest to validity if a vendor pays them enough. However, just as a sign outside a restaurant promising “fine gourmet dining” usually means the opposite, certain firms’ attestations of validity are generally “red flags,” which suggest exactly the opposite: that the vendor’s methodology is invalid.
The key: Does the letter attesting to the validity of the methodology also contain a financial guarantee that the validators themselves accept liability for the veracity of those attestations? If not, the Letter of Validation itself is invalid.
The following vendors — and only the following vendors — measure validly, for the offerings noted, with qualifications (if any) noted. If a vendor not on this list, it could not obtain a risk-bearing letter from DMPC or any other organization that verifies validity. If a vendor is on this list, it could…and did.
Each letter is different depending on the category in which the vendor competes. In wellness, for example, the Gold Standard letter is a commitment-based pledge, since today wellness vendors rarely have access to claims data and don’t plausibility-test results when they do:
- The vendor’s front-line recommendation is to compare all risk factors on a population (90% + of the population being measured) over multiple years and that reconciliations are done based on this recommendation, with the difference in risk factors being the improvement believed to be attributable to the program
- The vendor agrees to disclose to customers that, while they are perfectly willing to reconcile in some other way and/or reconcile only on a subset of the population, such a reconciliation will likely lead to an invalid result
- The vendor acknowledges that neither it nor any other vendor can achieve a positive first-year ROI through a wellness program
- The vendor will distribute the Wellness Savings Calculator along with any proposal if requested
- The vendor will encourage the carrier to utilize Step 4 below to measure wellness impact using claims data and/or offer, as an extra service, that step.
For carriers, the letter is outcomes-based. The utilization management Gold Standard consists of the following, over multiple years:
- Tracking grouped Episodes of Care per 1000 and admissions per 1000
- Calculating the ratio of the latter to the former as a combined measure of how often the episode was resolvable without inpatient care
- Repeating the exercise for groupings of cardiometabolic, respiratory, musculoskeletal, mental health and substance abuse, preference-sensitive conditions and prenatal, perinatal, and neonatal complications of birth events
- Grouping cardiometabolic and musculoskeletal events, plus bariatric surgeries and diagnoses of obesity, into a health-sensitive conditions metagroup that captures the large majority of the utilization changes that may be attributable to wellness programs.
For other vendors that don’t fit in those categories, such as Quantum Health, NaviHealth and Electrochemical Oxygen Concepts on the charter list below, the methodologies specific to the claims must be valid in the opinion of the validator and DMPC.
Note: There is no charge for listing on this website. All that is required is a risk-bearing Letter of Validation from any qualified source, basically covering the points above. Therefore any organization that can attain such a letter has no reason not to post here and every reason to post here. It can therefore be inferred that a vendor/carrier or consultant not being listed here is offering or advising respectively, that an invalid methodology be used to measure outcomes.
| Vendor | Measurement and/or Vendor Promise of Savings Attested to By the Auditor’s Letter | Comments/Qualifications |
|---|---|---|
| Allone (www.allonehealth.com) |
Total risk factors on the total population are measured at regular intervals, period. | Measurement is as stated in Why Nobody Believes the Numbers – Allone is the only vendor to “take the pledge” and embrace valid measurement for its wellness program. (There would be exceptions on religious grounds, and of course the customer would have to want to re-measure all employees.) |
| Electrochemical Oxygen Concepts (www.eo2concepts.com) |
A health plan will spend less on diabetic wounds (per diabetic member), period. This means fewer wounds, lower-grade wounds, and faster healing. | Health plans must incentivize or require consideration of use of product as a first-line therapy before going to negative pressure or hyperbaric chambers. |
| Equity Healthcare (www.equityhealthcare.com) |
First healthplan services provider to show BofB reduction in trend (and outperformance of national trend) confirmed by reduction in inpatient utilization using the utilization measurement “gold standard” to capture combined impact of all UM/DM/CM/wellness activities. | Sells exclusively to private equity firms and their portfolio companies, which are interested in getting savings, not showing savings. (The two concepts are polar opposites.) EH has lowered trend by total population health management, with savings confirmed by utilization reductions in the categories of care most amenable to such management. |
| Healthways, Inc. (www.healthways.com) |
Well-Being Improvement for total populations as measured by a validated Well-Being Assessment™, allowing comparison to Gallup-Healthways Well-Being Index™ and financial translation of that change to reduced medical cost and improvement in job performance and productivity. Entire population is measured in all periods, avoiding all common measurement fallacies.. | The first and, to our knowledge, only company to offer a comprehensive well-being program, Healthways has scientifically proven the correlation between well-being scores and health care cost, utilization, job performance and productivity in a way that wellness vendors haven’t. Healthways has also demonstrated the effectiveness of their Well-Being Improvement Solution in improving population well-being at Fortune 50 and 100 companies. |
| HR Best Practices (www.hrbestpractices.com) |
Uniquely, it's not an ROI until the client says it's an ROI. This allows the client to measure using a valid methodology. | No other vendor offers anything like this. Contracts contain no third-party dispute resolution provision for financial performance disputes because there can't be a financial performance dispute. The customer is always right. |
| NaviHealth (www.navihealth.us) |
Takes full risk on all postacute spending to guarantee immediate savings, period. (Measures in utilization to avoid inflation invalidities.) | There is also the possibility of a higher RAF because NaviHealth will refer people to the HCC vendor who otherwise might have been missed. Further, Stars scores should rise as well. |
| Quantum Health (www.quantum-health.com) |
Reduction in utilization of (defined) high-cost resources, period. | As Why Nobody Believes points out, anyone can guarantee savings against “trend,” simply by using the CCA Guidelines, which overstate trend. However, population-wide utilization reduction outcomes cannot be gamed. |
| stickK (www.stickk.com) |
Like AllOne, stickK wll not claim to produce a specific ROI and acknowledges that short-term wellness ROI —whether stickK’s or anyone else’s—can’t be proven.
However, the nature of the stickK intervention—“Commitment Contracts” that channel intrinsic motivation into a binding agreement to achieve a personal goal—will by definition be more effective than any goal paid for by employer incentives, according to the responsible literature on incentives. |
Unlike most wellness vendors stickK also offers a B-to-C version that people pay for, which itself provides evidence of value. (Contrast this to HRAs, that nobody pays for, and telephone coaching, that few people do.) To make a Commitment Contract, a user specifies his or her goal—e.g. “I want to lose 20 lbs.”—and can then place financial stakes on the line to be forfeited if unsuccessful, invite a third-party Referee to verify progress, and add friends and family to offer encouragement. |
| Strategic Benefit Solutions (a Marsh & McLennen Agency whose population management staff is based in Atlanta, Georgia) | Only Why Nobody Believes the Numbers event-based metrics are used for measuring event reduction from population health management | One of very few population health consulting firms backed by a DMPC Letter of Validation due to its commitment to valid metrics – measurement on the entire population, period – and not automatically linking coincidental cost reduction to risk reduction. |
890 Winter Street, Suite 208
Waltham, MA 02451
Phone: 781 856 3962
Fax: 781 884 4150
Email: alewis@dismgmt.com
