Quantile regression is essential for analyzing the relationship between conditional quantiles of independent and dependent variables, widely applied in economics, education, social science, and beyond. However, traditional methods often struggle with nonlinearity, high dimensionality, and other complexities in data. To address these challenges, this paper innovatively integrates the cascade architecture into quantile regression forests, proposing the deep quantile forest method. Unlike existing deep-quantile regression estimators, our approach requires fewer hyperparameters and less training data while offering better performance and enhanced interpretability. Extensive numerical simulations and real-world data experiments demonstrate that our proposed method outperforms competing methods, showcasing its effectiveness and robustness in handling the complex structures of high-dimensional data.

References

• Atomsa, G. A., & Zhou, Y. (2023). Application of neural network to model rainfall pattern of Ethiopia. Statistical Theory and Related Fields, 7(1), 69–84. https://doi.org/10.1080/24754269.2022.2136266
• Bassett, G., & Koenker, R. (1978). Regression quantiles. Econometrica, 46(1), 33–50. https://doi.org/10.2307/1913643
• Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. https://doi.org/10.1023/A:1010933404324
• Chaudhuri, P. (1991). Global nonparametric estimation of conditional quantile functions and their derivatives. Journal of Multivariate Analysis, 39(2), 246–269. https://doi.org/10.1016/0047-259X(91)90100-G
• Chen, X., & White, H. (1999). Improved rates and asymptotic normality for nonparametric neural network estimators. IEEE Transactions on Information Theory, 45(2), 682–691. https://doi.org/10.1109/18.749011
• Feng, X., He, X., Jiao, Y., Kang, L., & Wang, C. (2024). Deep nonparametric quantile regression under covariate shift. Journal of Machine Learning Research, 25(385), 1–50.
• He, X., Ng, P., & Portnoy, S. (2002). Bivariate quantile smoothing splines. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 60(3), 537–550. https://doi.org/10.1111/1467-9868.00138
• Jia, Y., & Jeong, J. (2022). Deep learning for quantile regression under right censoring: DeepQuantreg. Computational Statistics & Data Analysis, 165, 107323. https://doi.org/10.1016/j.csda.2021.107323
• Koenker, R. (2017). Quantile regression: 40 years on. Annual Review of Economics, 9(1), 155–176. https://doi.org/10.1146/economics.2017.9.issue-1
• Koenker, R., & Machado, J. A. F. (1999). Goodness of fit and related inference processes for quantile regression. Journal of the American Statistical Association, 94(448), 1296–1310. https://doi.org/10.1080/01621459.1999.10473882
• LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. https://doi.org/10.1038/nature14539
• Lee, S. (2003). Efficient semiparametric estimation of a partially linear quantile regression model. Econometric Theory, 19(1), 1–31. https://doi.org/10.1017/S0266466603191013
• Lee, Y. K., Mammen, E., & Park, B. U. (2010). Backfitting and smooth backfitting for additive quantile models. The Annals of Statistics, 38(5), 2857–2883. https://doi.org/10.1214/10-AOS808
• Manski, C. F. (1975). Maximum score estimation of the stochastic utility model of choice. Journal of Econometrics, 3(3), 205–228. https://doi.org/10.1016/0304-4076(75)90032-9
• Meinshausen, N. (2006). Quantile regression forests. Journal of Machine Learning Research, 7(6), 983–999.
• Powell, J. L. (1986). Censored regression quantiles. Journal of Econometrics, 32(1), 143–155. https://doi.org/10.1016/0304-4076(86)90016-3
• Shen, G., Jiao, Y., Lin, Y., Horowitz, J., & Huang, J. (2021). Deep quantile regression: Mitigating the curse of dimensionality through composition. arXiv preprint.
• Shen, G., Jiao, Y., Lin, Y., Horowitz, J. L., & Huang, J. (2024). Nonparametric estimation of non-crossing quantile regression process with deep ReQU neural networks. Journal of Machine Learning Research, 25(88), 1–75.
• Utkin, L. V., & Konstantinov, A. V. (2022). Attention-based random forest and contamination model. Neural Networks, 154, 346–359. https://doi.org/10.1016/j.neunet.2022.07.029
• Wang, H., & Cao, R. (2025). Deep learning quantile regression for interval-valued data prediction. Journal of Forecasting, 44(5), 1806–1825. https://doi.org/10.1002/for.v44.5
• Wang, Z. (2023). Research on Variable Importance Estimation Based on Deep Forest [D]. Nanjing Medical University. https://doi.org/10.27249/d.cnki.gnjyu.2023.000487
• White, H. (1992). Nonparametric estimation of conditional quantiles using neural networks. In C. Page & R. LePage (Eds.), Computing Science and Statistics (pp. 190–199). Springer.
• Zhang, Y., Wang, L., Yu, M., & Shao, J. (2019). Quantile treatment effect estimation with dimension reduction. Statistical Theory and Related Fields, 4(2), 202–213. https://doi.org/10.1080/24754269.2019.1696645
• Zhou, Z., & Feng, J. (2018). Deep forest. National Science Review, 6(1), 74–86. https://doi.org/10.1093/nsr/nwy108

To cite this article: Chuanquan Li, Yourong Zhang, Qi Kuang & Yini Liu (30 Jan 2026): Deep quantile forests for high-dimensional data, Statistical Theory and Related Fields, DOI: 10.1080/24754269.2026.2616873
To link to this article: https://doi.org/10.1080/24754269.2026.2616873