Putting CATs and item banks to work: How to construct predictive and sensitive PROMIS screeners for use in ambulatory oncology

Basch, E., Barbera, L., Kerrigan, C. L., & Velikova, G. (2018). Implementation of patient-reported outcomes in routine medical care. American Society of Clinical Oncology Educational Book, 38, 122–134.

PubMed  Google Scholar 

Garcia, S. F., Wortman, K., Cella, D., Wagner, L. I., Bass, M., Kircher, S., Pearman, T., & Penedo, F. J. (2019). Implementing electronic health record–integrated screening of patient-reported symptoms and supportive care needs in a comprehensive cancer center. Cancer, 125(22), 4059–4068.

PubMed  Google Scholar 

Wagner, L. I., Schink, J., Bass, M., Patel, S., Diaz, M. V., Rothrock, N., Pearman, T., Gershon, R., Penedo, F. J., & Rosen, S. (2015). Bringing PROMIS to practice: Brief and precise symptom screening in ambulatory cancer care. Cancer, 121(6), 927–934.

PubMed  Google Scholar 

Jacobsen, P. B., & Wagner, L. I. (2012). A new quality standard: The integration of psychosocial care into routine cancer care. Journal of Clinical Oncology, 30(11), 1154–1159.

PubMed  Google Scholar 

Bjorner, J. B., Chang, C. H., Thissen, D., & Reeve, B. B. (2007). Developing tailored instruments: Item banking and computerized adaptive assessment. Quality of Life Research, 16(1), 95–108.

PubMed  Google Scholar 

Snyder, C. F., Aaronson, N. K., Choucair, A. K., Elliott, T. E., Greenhalgh, J., Halyard, M. Y., Hess, R., Miller, D. M., Reeve, B. B., & Santana, M. (2012). Implementing patient-reported outcomes assessment in clinical practice: A review of the options and considerations. Quality of Life Research, 21, 1305–1314.

PubMed  Google Scholar 

Lyleroehr, M. J., Webster, K., Perry, L. M., Patten, E., Smith, J. D., Penedo, F. J., & Garcia, S. F. (in press). A mixed methods evaluation of patient perspectives on the implementation of an electronic health Record-Integrated patient-Reported symptom and needs monitoring program in Cancer care. Journal of Patient-Reported Outcomes.

Segawa, E., Schalet, B., & Cella, D. (2020). A comparison of computer adaptive tests (CATs) and short forms in terms of accuracy and number of items administrated using PROMIS profile. Quality of Life Research, 29(1), 213–221.

PubMed  Google Scholar 

Van Stralen, K. J., Stel, V. S., Reitsma, J. B., Dekker, F. W., Zoccali, C., & Jager, K. J. (2009). Diagnostic methods I: Sensitivity, specificity, and other measures of accuracy. Kidney International, 75(12), 1257–1263.

PubMed  Google Scholar 

Trevethan, R. (2017). Sensitivity, specificity, and predictive values: Foundations, pliabilities, and pitfalls in research and practice. Frontiers in Public Health, 5, 308890.

Google Scholar 

Mitchell, A. J. (2011). Sensitivity× PPV is a recognized test called the clinical utility index (CUI+). European Journal of Epidemiology, 26, 251–252.

PubMed  Google Scholar 

Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., & Choi, S. (2010). The Patient-Reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63(11), 1179–1194.

PubMed  PubMed Central  Google Scholar 

Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., & Cella, D. (2011). Item banks for measuring emotional distress from the Patient-Reported outcomes measurement information system (PROMIS®): Depression, anxiety, and anger. Assessment, 18(3), 263–283.

Amtmann, D., Cook, K. F., Jensen, M. P., Chen, W. H., Choi, S., Revicki, D., Cella, D., Rothrock, N., Keefe, F., & Callahan, L. (2010). Development of a PROMIS item bank to measure pain interference. Pain, 150(1), 173–182.

PubMed  PubMed Central  Google Scholar 

Lai, J. S., Cella, D., Chang, C. H., Bode, R. K., & Heinemann, A. W. (2003). Item banking to improve, shorten And computerize self-reported fatigue: An illustration of steps to create a core item bank from the FACIT-Fatigue scale. Quality of Life Research, 12(5), 485–501.

PubMed  Google Scholar 

Rose, M., Bjorner, J. B., Gandek, B., Bruce, B., Fries, J. F., & Ware, J. E. (2014). The PROMIS physical function item bank was calibrated to a standardized metric and shown to improve measurement efficiency. Journal of Clinical Epidemiology, 67(5), 516–526.

PubMed  PubMed Central  Google Scholar 

Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika monograph supplement.

Bock, R. D., & Mislevy, R. J. (1982). Adaptive EAP Estimation of ability in a microcomputer environment. Applied Psychological Measurement, 6(4), 431–444.

Google Scholar 

Hol, A. M., Vorst, H. C., & Mellenbergh, G. J. (2007). Computerized adaptive testing for polytomous motivation items: Administration mode effects and a comparison with short forms. Applied Psychological Measurement, 31(5), 412–429.

Google Scholar 

Reise, S. P., Henson, J. M., & Assessment (2000). 7(4), 347–364.

Yu, L., Buysse, D. J., Germain, A., Moul, D. E., Stover, A., Dodds, N. E., Johnston, K. L., & Pilkonis, P. A. (2012). Development of short forms from the PROMIS™ sleep disturbance and sleep-related impairment item banks. Behavioral Sleep Medicine, 10(1), 6–24.

Google Scholar 

Cella, D., Choi, S. W., Condon, D. M., Schalet, B., Hays, R. D., Rothrock, N. E., Yount, S., Cook, K. F., Gershon, R. C., & Amtmann, D. (2019). PROMIS® adult health profiles: Efficient Short-Form measures of seven health domains. Value in Health, 22(5), 537–544.

Choi, S. W., Reise, S. P., Pilkonis, P. A., Hays, R. D., & Cella, D. (2010). Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Quality of Life Research, 19(1), 125–136.

PubMed  Google Scholar 

Van der Linden, W. J. (1998). Bayesian item selection criteria for adaptive testing. Psychometrika, 2, 201–216.

Google Scholar 

Edelen, M. O., Zeng, C., Hays, R. D., Rodriguez, A., Hanmer, J., Baumhauer, J., Cella, D., Reeve, B. B., & Herman, P. M. (2024). Development of an ultra-short measure of eight domains of health-related quality of life for research and clinical care: the patient-reported outcomes measurement information system®PROMIS®-16 profile (pp. 1–12). Quality of Life Research.

Jensen, R. E., Moinpour, C. M., Potosky, A. L., Lobo, T., Hahn, E. A., Hays, R. D., Cella, D., Smith, A. W., Wu, X. C., & Keegan, T. H. (2016). Responsiveness of 8 Patient-Reported Outcomes Measurement Information System (PROMIS) measures in a large, community‐based cancer study cohort. Cancer.

Cella, D., Choi, S., Garcia, S., Cook, K. F., Rosenbloom, S., Lai, J. S., Tatum, D. S., & Gershon, R. (2014). Setting standards for severity of common symptoms in oncology using the PROMIS item banks and expert judgment. Quality of Life Research, 23(10), 2651–2661.

PubMed  PubMed Central  Google Scholar 

Rothrock, N. E., Cook, K. F., O’Connor, M., Cella, D., Smith, A. W., & Yount, S. E. (2019). Establishing clinically-relevant terms and severity thresholds for Patient-Reported outcomes measurement information System®(PROMIS®) measures of physical function, cognitive function, and sleep disturbance in people with cancer using standard setting. Quality of Life Research, 28, 3355–3362.

Sikorskii, A., Tam, S., Given, B., Given, C. W., Boakye, A., Zatirka, E., Nair, T., Su, M., Jogunoori, W. T. K., S., & Watson, P. (2024). Thresholds in PROMIS Scores Anchored to Subsequent Unscheduled Health Service Use Among People Diagnosed With Cancer. JCO Oncology Practice, OP. 23.00356.

Gilbody, S., Richards, D., Brealey, S., & Hewitt, C. (2007). Screening for depression in medical settings with the patient health questionnaire (PHQ): A diagnostic meta-analysis. Journal of General Internal Medicine, 22, 1596–1602.

PubMed  PubMed Central  Google Scholar 

Manea, L., Gilbody, S., & McMillan, D. (2012). Optimal cut-off score for diagnosing depression with the patient health questionnaire (PHQ-9): A meta-analysis. Canadian Medical Association Journal, 184(3), E191–E196.

PubMed  PubMed Central  Google Scholar 

Mitchell, A. (2008). Are one or two simple questions sufficient to detect depression in cancer and palliative care? A bayesian meta-analysis. British Journal of cancer, 98(12), 1934–1943.

PubMed  PubMed Central  CAS  Google Scholar 

Mitchell, A., McGlinchey, J., Young, D., Chelminski, I., & Zimmerman, M. (2009). Accuracy of specific symptoms in the diagnosis of major depressive disorder in psychiatric out-patients: Data from the MIDAS project. Psychological Medicine, 39(7), 1107–1116.

PubMed  CAS  Google Scholar 

RCoreTeam. (2021). R: A Language and environment for statistical computing. R Foundation for Statistical Computing.

Choi, S. W. (2009). Firestar: Computerized adaptive testing simulation program for polytomous item response theory models. Applied Psychological Measurement, 33, 644–645.

Google Scholar 

Kuhn, M., & Hvitfeldt, V. D. (2024). E. yardstick: Tidy Characterizations of Model Performance (Version R package version 1.3.1).

De Vet, H. C., Terwee, C. B., Mokkink, L. B., & Knol, D. L. (2011). Measurement in medicine: A practical guide. Cambridge University Press.

Choi, S. W., Reise, S. P., Pilkonis, P. A., Hays, R. D., & Cella, D. (2010). Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Quality of Life Research, 19, 125–136.

PubMed  Google Scholar 

Snyder, C. F., Jensen, R. E., Geller, G., Carducci, M. A., & Wu, A. W. (2010). Relevant content for a patient-reported outcomes questionnaire for use in oncology clinical practice: Putting Doctors and patients on the same page. Quality of Life Research, 19, 1045–1055.

PubMed  Google Scholar 

Wagner, L. I., Schink, J., Bass, M., Patel, S., Diaz, M. V., Rothrock, N., Pearman, T., Gershon, R., Penedo, F. J., Rosen, S., & Cella, D. (2015). Bringing PROMIS to practice: Brief and precise symptom screening in ambulatory cancer care. Cancer, 121(6), 927–934.

PubMed  Google Scholar 

Coons, S. J., Gwaltney, C. J., Hays, R. D., Lundy, J. J., Sloan, J. A., Revicki, D. A., Lenderking, W. R., Cella, D., & Basch, E. (2009). Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient‐reported outcome (PRO) measures: ISPOR ePRO good research practices task force report. Value in Health, 12(4), 419–429.

PubMed  Google Scholar 

Comments (0)

No login
gif