The Creative Achievement Questionnaire (CAQ) is widely used to measure the creative achievement levels of individuals. Previous studies reported a varying range of reliability coefficients for the CAQ. To this date, no study has investigated the variability in the reliability coefficients of the CAQ. A random-effects reliability generalization meta-analysis, heterogeneity analyses, and moderator analyses were conducted in the present study to examine the variability in the reliability coefficients. The mean alpha value for the total CAQ score was estimated to be 0.765 (95% CI: 0.708-0.811). The Q test (Q[subscript (33)] = 1716.648, p < 0.0001) and I[superscript 2] (98.74%) values denoted statistically significant heterogeneity among the alpha coefficients. These findings indicate that reliability is a property of CAQ scores and that the reliability of scores changes significantly across samples. The moderator analyses showed that the reliability coefficients were not impacted by the moderator variables considered in this study. However, certain moderator variables that were not included in the analyses may have impacted the reliability coefficients. The findings of the present study imply that the CAQ can be used for exploratory research.