Current Research and Open Gaps in Federated Large Language Models: A Systematic Review
DOI:
https://doi.org/10.5753/reviews.2026.6627Keywords:
FedLLM, LLM technologies, Systematic Review, Federated LearningAbstract
The integration of Large Language Models (LLMs) with Federated Learning (FL), known as FedLLMs, enables decentralized model training while preserving data privacy. However, this integration introduces novel challenges while also inheriting existing issues from FL and LLMs. This systematic review addresses the research question: How are the key challenges in Federated Large Language Models being addressed in current research, and what gaps remain to be explored? We analyzed 168 studies across four major databases, applying eligibility criteria that resulted in 24 studies for detailed synthesis. Findings were organized across twelve key challenges: multimodal foundation model integration; data erasure, legal, ethical, and property rights; environmental sustainability and energy efficiency; federated learning over black-box LLMs; personalization and domain adaptation; continual learning and continuous data streams; communication overhead and efficiency constraints; security and robustness; heterogeneous data, devices, and resources; computational efficiency and resource constraints; and data privacy preservation. While some challenges have received attention, solutions are often limited to narrow domains or experimental datasets, and several remain unaddressed. These insights highlight critical gaps and provide a foundation for future research toward generalizable, responsible, and sustainable LLM technologies.
Downloads
References
Acar, D. A. E., Zhao, Y., Navarro, R. M., Mattina, M., Whatmough, P. N., and Saligrama, V. (2021). Federated learning based on dynamic regularization. arXiv preprint arXiv:2111.04263. DOI: 10.48550/arxiv.2111.04263.
Adjewa, F., Esseghir, M., and Merghem-Boulahia, L. (2024). Efficient federated intrusion detection in 5g ecosystem using optimized bert-based model. In 2024 20th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), pages 62-67. DOI: 10.1109/WiMob61911.2024.10770340.
Ahmad, A., Luo, W., and Robles-Kelly, A. (2023). Robust federated learning under statistical heterogeneity via hessian spectral decomposition. Pattern Recognition, 141:109635. DOI: 10.1016/j.patcog.2023.109635.
Ait-Mlouk, A., Alawadi, S. A., Toor, S., and Hellander, A. (2022). Fedqas: Privacy-aware machine reading comprehension with federated learning. Applied Sciences, 12(6). DOI: 10.3390/app12063130.
Arruda, H., Silva, E. R., Lessa, M., Proença Jr, D., and Bartholo, R. (2022). Vosviewer and bibliometrix. Journal of the Medical Library Association: JMLA, 110(3):392. DOI: 10.5195/jmla.2022.1434.
Bao, G. and Guo, P. (2022). Federated learning in cloud-edge collaborative architecture: key technologies, applications and challenges. Journal of Cloud Computing, 11(1):94. DOI: 10.1186/s13677-022-00377-4.
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M. S., Bohg, J., Bosselut, A., Brunskill, E., et al. (2021). On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258. DOI: 10.48550/arxiv.2108.07258.
Bonawitz, K., Ivanov, V., Kreuter, B., Marcedone, A., McMahan, H. B., Patel, S., Ramage, D., Segal, A., and Seth, K. (2017). Practical secure aggregation for privacy-preserving machine learning. In Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security, CCS '17, page 1175–1191, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3133956.3133982.
Braun, V., Clarke, V., Boulton, E., Davey, L., and McEvoy, C. (2021). The online survey as a qualitative research tool. International journal of social research methodology, 24(6):641-654. DOI: 10.1080/13645579.2020.1805550.
Chen, C., Feng, X., Li, Y., Lyu, L., Zhou, J., Zheng, X., and Yin, J. (2024). Integration of large language models and federated learning. Patterns, 5(12). DOI: 10.1016/j.patter.2024.101098.
Chen, Y., Li, R., Shao, J., Sun, L., Zhang, C., Zhang, J., and Li, X. (2026). Federated lora fine-tuning of llms with only transmitting matrix a or b. IEEE Transactions on Mobile Computing. DOI: 10.1109/tmc.2026.3696859.
Cheng, Y., Zhang, W., Zhang, Z., Zhang, C., Wang, S., and Mao, S. (2024). Towards federated large language models: Motivations, methods, and future directions. IEEE Communications Surveys & Tutorials. DOI: 10.1109/COMST.2024.3503680.
DeepSeek-AI, Liu, A., Feng, B., Xue, B., Wang, B., Wu, B., Lu, C., Zhao, C., Deng, C., Zhang, C., Ruan, C., Dai, D., Guo, D., Yang, D., Chen, D., Ji, D., Li, E., Lin, F., Dai, F., Luo, F., Hao, G., Chen, G., Li, G., Zhang, H., Bao, H., Xu, H., Wang, H., Zhang, H., Ding, H., Xin, H., Gao, H., Li, H., Qu, H., Cai, J. L., Liang, J., Guo, J., Ni, J., Li, J., Wang, J., Chen, J., Chen, J., Yuan, J., Qiu, J., Li, J., Song, J., Dong, K., Hu, K., Gao, K., Guan, K., Huang, K., Yu, K., Wang, L., Zhang, L., Xu, L., Xia, L., Zhao, L., Wang, L., Zhang, L., Li, M., Wang, M., Zhang, M., Zhang, M., Tang, M., Li, M., Tian, N., Huang, P., Wang, P., Zhang, P., Wang, Q., Zhu, Q., Chen, Q., Du, Q., Chen, R. J., Jin, R. L., Ge, R., Zhang, R., Pan, R., Wang, R., Xu, R., Zhang, R., Chen, R., Li, S. S., Lu, S., Zhou, S., Chen, S., Wu, S., Ye, S., Ye, S., Ma, S., Wang, S., Zhou, S., Yu, S., Zhou, S., Pan, S., Wang, T., Yun, T., Pei, T., Sun, T., Xiao, W. L., Zeng, W., Zhao, W., An, W., Liu, W., Liang, W., Gao, W., Yu, W., Zhang, W., Li, X. Q., Jin, X., Wang, X., Bi, X., Liu, X., Wang, X., Shen, X., Chen, X., Zhang, X., Chen, X., Nie, X., Sun, X., Wang, X., Cheng, X., Liu, X., Xie, X., Liu, X., Yu, X., Song, X., Shan, X., Zhou, X., Yang, X., Li, X., Su, X., Lin, X., Li, Y. K., Wang, Y. Q., Wei, Y. X., Zhu, Y. X., Zhang, Y., Xu, Y., Xu, Y., Huang, Y., Li, Y., Zhao, Y., Sun, Y., Li, Y., Wang, Y., Yu, Y., Zheng, Y., Zhang, Y., Shi, Y., Xiong, Y., He, Y., Tang, Y., Piao, Y., Wang, Y., Tan, Y., Ma, Y., Liu, Y., Guo, Y., Wu, Y., Ou, Y., Zhu, Y., Wang, Y., Gong, Y., Zou, Y., He, Y., Zha, Y., Xiong, Y., Ma, Y., Yan, Y., Luo, Y., You, Y., Liu, Y., Zhou, Y., Wu, Z. F., Ren, Z. Z., Ren, Z., Sha, Z., Fu, Z., Xu, Z., Huang, Z., Zhang, Z., Xie, Z., Zhang, Z., Hao, Z., Gou, Z., Ma, Z., Yan, Z., Shao, Z., Xu, Z., Wu, Z., Zhang, Z., Li, Z., Gu, Z., Zhu, Z., Liu, Z., Li, Z., Xie, Z., Song, Z., Gao, Z., and Pan, Z. (2025). Deepseek-v3 technical report. DOI: 10.48550/arxiv.2412.19437.
Djuhera, A., Andrei, V. C., Li, X., Mönich, U. J., Boche, H., and Saad, W. (2025). R-sfllm: Jamming resilient framework for split federated learning with large language models. IEEE Transactions on Information Forensics and Security. DOI: 10.1109/tifs.2025.3594107.
Fan, T., Gu, H., Cao, X., Chan, C. S., Chen, Q., Chen, Y., Feng, Y., Gu, Y., Geng, J., Luo, B., et al. (2025). Ten challenging problems in federated foundation models. IEEE Transactions on Knowledge and Data Engineering. DOI: 10.1109/tkde.2025.3555328.
Gholamiangonabadi, D. and Grolinger, K. (2024). Federated learning for sentiment analysis in presence of non-iid data: Sensitivity of deep learning models. IEEE Access, 12:128049-128060. DOI: 10.1109/ACCESS.2024.3453068.
Ghosh, A., Chung, J., Yin, D., and Ramchandran, K. (2020). An efficient framework for clustered federated learning. In Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M., and Lin, H., editors, Advances in Neural Information Processing Systems, volume 33, pages 19586-19597. Curran Associates, Inc.. DOI: 10.1109/tit.2022.3192506.
Han, C., Yang, T., Cui, Z., and Sun, X. (2025). A privacy-preserving and trustworthy inference framework for llm-iot integration via hierarchical federated collaborative computing. IEEE Internet of Things Journal. DOI: 10.1109/jiot.2025.3583764.
Han, G., Zhang, T., Zhang, Y., Xu, G., Sun, J., and Cao, J. (2022). Verifiable and privacy preserving federated learning without fully trusted centers. Journal of Ambient Intelligence and Humanized Computing, 13(3):1431-1441. DOI: 10.1007/s12652-020-02664-x.
Hasan, M. K., Kabir, S. R., Islam, S., Abdullah, S., Abbas, H. S., Pandey, B., and Gadekallu, T. R. (2025). Aes cryptography enabled responsible federated foundation model using transformer llm and lstm for smart grid iiot networks. IEEE Internet of Things Journal. DOI: 10.1109/jiot.2025.3608807.
Higgins, J. P., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page, M. J., and Welch, V. A. (2019). Cochrane Handbook for Systematic Reviews of Interventions. Wiley-Blackwell, 2nd edition. Book.
Hilmkil, A., Callh, S., Barbieri, M., Sütfeld, L. R., Zec, E. L., and Mogren, O. (2021). Scaling federated learning for fine-tuning of large language models. In International Conference on Applications of Natural Language to Information Systems, pages 15-23. Springer. DOI: 10.1007/978-3-030-80599-9_2.
Hong, M., Zhang, K., Zhang, S., and He, Z. (2023). Fednpc: A federated learning framework for large language models in game npcs. In 2023 IEEE 21st Student Conference on Research and Development (SCOReD), pages 363-368. DOI: 10.1109/SCOReD60679.2023.10563705.
Hu, J., Wang, D., Wang, Z., Pang, X., Xu, H., Ren, J., and Ren, K. (2024). Federated large language model: Solutions, challenges and future directions. IEEE Wireless Communications. DOI: 10.1109/mwc.009.2400244.
Iftikhar, S. and Davy, S. (2024). Reducing carbon footprint in ai: A framework for sustainable training of large language models. In Arai, K., editor, Proceedings of the Future Technologies Conference (FTC) 2024, Volume 1, pages 325-336, Cham. Springer Nature Switzerland. DOI: 10.1007/978-3-031-73110-5_22.
Jiang, J., Jiang, H., Ma, Y., Liu, X., and Fan, C. (2024). Low-parameter federated learning with large language models. In Jin, C., Yang, S., Shang, X., Wang, H., and Zhang, Y., editors, Web Information Systems and Applications, pages 319-330, Singapore. Springer Nature Singapore. DOI: 10.1007/978-981-97-7707-5_28.
Jiang, Y., Li, Z., and Song, B. (2025). Fine-tuning large language models in federated learning with fairness-aware prompt selection. Neural Networks, page 108160. DOI: 10.1016/j.neunet.2025.108160.
Karimireddy, S. P., Kale, S., Mohri, M., Reddi, S., Stich, S., and Suresh, A. T. (2020). SCAFFOLD: Stochastic controlled averaging for federated learning. In III, H. D. and Singh, A., editors, Proceedings of the 37th International Conference on Machine Learning, volume 119 of Proceedings of Machine Learning Research, pages 5132-5143. PMLR. DOI: 10.48550/arxiv.1910.06378.
Kim, G., Yoo, J., and Kang, S. (2023). Efficient federated learning with pre-trained large language model using several adapter mechanisms. Mathematics, 11(21). DOI: 10.3390/math11214479.
Kuang, W., Qian, B., Li, Z., Chen, D., Gao, D., Pan, X., Xie, Y., Li, Y., Ding, B., and Zhou, J. (2024). Federatedscope-llm: A comprehensive package for fine-tuning large language models in federated learning. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD '24, page 5260–5271, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3637528.3671573.
Kumar, J. and Chimalakonda, S. (2024). Code summarization without direct access to code - towards exploring federated llms for software engineering. In Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering, EASE '24, page 100–109, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3661167.3661210.
Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., and Smith, V. (2020). Federated optimization in heterogeneous networks. In Dhillon, I., Papailiopoulos, D., and Sze, V., editors, Proceedings of Machine Learning and Systems, volume 2, pages 429-450. DOI: 10.48550/arxiv.1812.06127.
Li, Y., Sun, J., Liu, Y., Zhang, Y., Li, A., Chen, B., Roth, H. R., Xu, D., Chen, T., and Chen, Y. (2024). Federated black-box prompt tuning system for large language models on the edge. In Proceedings of the 30th Annual International Conference on Mobile Computing and Networking, ACM MobiCom '24, page 1775–1777, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3636534.3698856.
Liu, X., Pang, T., and Fan, C. (2023). Federated prompting and chain-of-thought reasoning for improving llms answering. In Jin, Z., Jiang, Y., Buchmann, R. A., Bi, Y., Ghiran, A.-M., and Ma, W., editors, Knowledge Science, Engineering and Management, pages 3-11, Cham. Springer Nature Switzerland. DOI: 10.1007/978-3-031-40292-0_1.
Luo, W., Keung, J. W., Yang, B., Ye, H., Goues, C. L., Bissyande, T. F., Tian, H., and Le, B. (2026). When fine-tuning llms meets data privacy: An empirical study of federated learning in llm-based program repair. ACM Transactions on Software Engineering and Methodology, 35(3):1-46. DOI: 10.1145/3733599.
Mawela, C., Issaid, C. B., and Bennis, M. (2025). A web-based solution for federated learning with llm-based automation. IEEE Internet of Things Journal. DOI: 10.1109/jiot.2025.3542897.
McMahan, B., Moore, E., Ramage, D., Hampson, S., and Arcas, B. A. y. (2017). Communication-Efficient Learning of Deep Networks from Decentralized Data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, volume 54 of Proceedings of Machine Learning Research, pages 1273-1282. PMLR. DOI: 10.48550/arxiv.1602.05629.
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., Group, P., et al. (2010). Preferred reporting items for systematic reviews and meta-analyses: the prisma statement. International journal of surgery, 8(5):336-341. DOI: 10.7326/0003-4819-151-4-200908180-00135.
Mothukuri, V., Parizi, R. M., Pouriyeh, S., Huang, Y., Dehghantanha, A., and Srivastava, G. (2021). A survey on security and privacy of federated learning. Future Generation Computer Systems, 115:619-640. DOI: 10.1016/j.future.2020.10.007.
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Glasziou, P. P., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., McGowan, J., Miller, C. M., Mockford, K., and Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, 372:n71. DOI: 10.1136/bmj.n71.
Pais, V., Rao, S., and Muniyal, B. (2025). Strategies for reducing the communication and computation costs in cross-silo federated learning: A comprehensive review. IEEE Access, 13:93385-93416. DOI: 10.1109/ACCESS.2025.3573933.
Petticrew, M. and Roberts, H. (2006). Systematic Reviews in the Social Sciences: A Practical Guide. Blackwell Publishing.
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., and Liu, P. J. (2020). Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140):1-67. DOI: 10.48550/arxiv.1910.10683.
Sadot, A. A. I. M., Maliha Mehjabin, M., and Mahafuz, A. (2023). A novel approach to efficient multilabel text classification: Bert-federated learning fusion. In 2023 26th International Conference on Computer and Information Technology (ICCIT), pages 1-6. DOI: 10.1109/ICCIT60459.2023.10441264.
Saha, S., Hota, A., Chattopadhyay, A. K., Nag, A., and Nandi, S. (2024). A multifaceted survey on privacy preservation of federated learning: progress, challenges, and opportunities. Artificial Intelligence Review, 57(7):184. DOI: 10.1007/s10462-024-10766-7.
Seo, J., Zhang, N., and Rong, C. (2023). Flexible and secure code deployment in federated learning using large language models: Prompt engineering to enhance malicious code detection. In 2023 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), pages 341-349. DOI: 10.1109/CloudCom59040.2023.00062.
So, J., He, C., Yang, C.-S., Li, S., Yu, Q., E Ali, R., Guler, B., and Avestimehr, S. (2022). Lightsecagg: a lightweight and versatile design for secure aggregation in federated learning. Proceedings of Machine Learning and Systems, 4:694-720. DOI: 10.48550/arxiv.2109.14236.
Solat, F. and Lee, J. (2026). Energy-and aoi-aware hierarchical personalized federated learning for distributed edge systems with selective llm module exchange. IEEE Internet of Things Journal. DOI: 10.1109/jiot.2026.3695103.
Su, H., Xiang, C., and Ramesh, B. (2024). Towards confidential chatbot conversations: A decentralised federated learning framework. The Journal of The British Blockchain Association. DOI: 10.31585/jbba-7-1-(3)2024.
Sujaykumar Reddy, M., Karnati, H., and Mohana Sundari, L. (2024). Transformer-based federated learning models for recommendation systems. IEEE Access, 12:109596-109607. DOI: 10.1109/ACCESS.2024.3439668.
Sun, H., Tian, H., Ni, W., Zheng, J., Niyato, D., and Zhang, P. (2025). Federated low-rank adaptation for large models fine-tuning over wireless networks. IEEE Transactions on Wireless Communications, 24(1):659-675. DOI: 10.1109/TWC.2024.3497998.
Sun, W., Wang, X., Liang, Z., Chen, J., Lan, W., Chen, Y., and Wang, F. (2026a). Fedshieldllm: Measurement, detection and protection of privacy leakage in federated llms. IEEE Transactions on Mobile Computing. DOI: 10.1109/tmc.2026.3657229.
Sun, W., Wang, X., Liang, Z., Gong, T., Lan, W., Chen, Y., Li, H., and Wang, F. (2026b). Efficient and privacy-preserving federated knowledge learning for distributed llm. IEEE Transactions on Mobile Computing. DOI: 10.1109/tmc.2026.3674545.
T. Dinh, C., Tran, N., and Nguyen, J. (2020). Personalized federated learning with moreau envelopes. In Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M., and Lin, H., editors, Advances in Neural Information Processing Systems, volume 33, pages 21394-21405. Curran Associates, Inc.. DOI: 10.48550/arxiv.2006.08848.
Tan, C., Wen, R., Li, R., Zhao, Z., Hossain, E., and Zhang, H. (2025). Tool-aided evolutionary llm for generative policy toward efficient resource management in wireless federated learning. IEEE Journal on Selected Areas in Communications. DOI: 10.1109/jsac.2025.3645754.
Tenney, I., Das, D., and Pavlick, E. (2019). BERT rediscovers the classical NLP pipeline. In Korhonen, A., Traum, D., and Màrquez, L., editors, Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4593-4601, Florence, Italy. Association for Computational Linguistics. DOI: 10.18653/v1/P19-1452.
Thapa, C., Tang, J. W., Abuadbba, A., Gao, Y., Camtepe, S., Nepal, S., Almashor, M., and Zheng, Y. (2023). Evaluation of federated learning in phishing email detection. Sensors, 23(9):4346. DOI: 10.3390/s23094346.
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., Bikel, D., Blecher, L., Ferrer, C. C., Chen, M., Cucurull, G., Esiobu, D., Fernandes, J., Fu, J., Fu, W., Fuller, B., Gao, C., Goswami, V., Goyal, N., Hartshorn, A., Hosseini, S., Hou, R., Inan, H., Kardas, M., Kerkez, V., Khabsa, M., Kloumann, I., Korenev, A., Koura, P. S., Lachaux, M.-A., Lavril, T., Lee, J., Liskovich, D., Lu, Y., Mao, Y., Martinet, X., Mihaylov, T., Mishra, P., Molybog, I., Nie, Y., Poulton, A., Reizenstein, J., Rungta, R., Saladi, K., Schelten, A., Silva, R., Smith, E. M., Subramanian, R., Tan, X. E., Tang, B., Taylor, R., Williams, A., Kuan, J. X., Xu, P., Yan, Z., Zarov, I., Zhang, Y., Fan, A., Kambadur, M., Narang, S., Rodriguez, A., Stojnic, R., Edunov, S., and Scialom, T. (2023). Llama 2: Open foundation and fine-tuned chat models. Available at:[link].
Truex, S., Liu, L., Chow, K.-H., Gursoy, M. E., and Wei, W. (2020). Ldp-fed: Federated learning with local differential privacy. In Proceedings of the third ACM international workshop on edge systems, analytics and networking, pages 61-66. DOI: 10.1145/3378679.3394533.
Vasconcelos, A. B., Drummond, L. M. d. A., Brum, R. C., and Paes, A. (2023). Exploring federated learning to trace depression in social media with language models. In 2023 International Symposium on Computer Architecture and High Performance Computing Workshops (SBAC-PADW), pages 24-30. DOI: 10.1109/SBAC-PADW60351.2023.00014.
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L. u., and Polosukhin, I. (2017). Attention is all you need. In Guyon, I., Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R., editors, Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc. Available at:[link].
Wang, D. (2024). Federated learning using gpt-4 boosted particle swarm optimization for compact neural architecture search. Journal of Advances in Information Technology, 15(9). DOI: 10.12720/jait.15.9.1011-1018.
Wei, K., Li, J., Ding, M., Ma, C., Yang, H. H., Farokhi, F., Jin, S., Quek, T. Q. S., and Vincent Poor, H. (2020). Federated learning with differential privacy: Algorithms and performance analysis. IEEE Transactions on Information Forensics and Security, 15:3454-3469. DOI: 10.1109/TIFS.2020.2988575.
Wu, F., Li, Z., Li, Y., Ding, B., and Gao, J. (2024a). Fedbiot: Llm local fine-tuning in federated learning without full model. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD '24, page 3345–3355, New York, NY, USA. Association for Computing Machinery. DOI: 10.1145/3637528.3671897.
Wu, J., Chen, L., Fang, S., and Wu, C. (2024b). An application programming interface (api) sensitive data identification method based on the federated large language model. Applied Sciences, 14(22). DOI: 10.3390/app142210162.
Xie, S., Wen, D., You, C., Chen, Q., Bennis, M., and Huang, K. (2026). Fedlodrop: Federated lora with dropout for generalized llm fine-tuning. IEEE Journal on Selected Areas in Communications. DOI: 10.1109/jsac.2026.3660935.
Xu, M., Cai, D., Wu, Y., Li, X., and Wang, S. (2023). Fwdllm: Efficient fedllm using forward gradient. arXiv preprint arXiv:2308.13894. DOI: 10.48550/arxiv.2308.13894.
Yan, N., Su, Y., Deng, Y., and Schober, R. (2025). Federated fine-tuning of llms: Framework comparison and research directions. IEEE Communications Magazine, 63(10):52-58. DOI: 10.1109/mcom.001.2400770.
Yao, Y., Zhang, J., Wu, J., Huang, C., Xia, Y., Yu, T., Zhang, R., Kim, S., Rossi, R., Li, A., et al. (2024). Federated large language models: Current progress and future directions. arXiv preprint arXiv:2409.15723. DOI: 10.1007/978-981-92-1468-6_12.
Ye, R., Wang, W., Chai, J., Li, D., Li, Z., Xu, Y., Du, Y., Wang, Y., and Chen, S. (2024). Openfedllm: Training large language models on decentralized private data via federated learning. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 6137-6147. DOI: 10.1145/3637528.3671582.
Yi, X., Hu, C., Cai, B., Huang, H., Chen, Y., and Wang, K. (2025). Fedalora: Adaptive local lora aggregation for personalized federated learning in llm. IEEE Internet of Things Journal. DOI: 10.1109/jiot.2025.3582427.
Yun, S., Bhuiyan, Z. A., Sadi, M. T. A. H., and Su, S. (2023). Privacy-preserving federated learning through clustered sampling on fine-tuning distributed non-iid large language models. In 2023 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking (ISPA/BDCloud/SocialCom/SustainCom), pages 531-538. DOI: 10.1109/ISPA-BDCloud-SocialCom-SustainCom59178.2023.00101.
Zhang, L., Ao, X., Guo, S., and Qiao, D. (2025a). Fedfa: Efficient federated large language models with feature adapters. Expert Systems with Applications, page 130894. DOI: 10.1016/j.eswa.2025.130894.
Zhang, T., Yu, H., Chen, Y., Wang, S., and Yang, Z. (2025b). Flaguard: Efficient verifiable federated lora of large language models. IEEE Transactions on Mobile Computing. DOI: 10.1109/tmc.2025.3641570.
Zhang, T., Yu, H., Yang, Z., Chen, Y., and Yu, S. (2025c). Lavfl: Efficient verifiable federated learning for large language models. IEEE Transactions on Dependable and Secure Computing. DOI: 10.1109/tdsc.2025.3581728.
Zhao, K., Yang, Z., Huang, C., Chen, X., and Zhang, Z. (2024). Fedsllm: federated split learning for large language models over communication networks. In 2024 International Conference on Ubiquitous Communication (Ucom), pages 438-443. IEEE. DOI: 10.1109/ucom62433.2024.10695888.
Zuo, X., Wang, M., Zhu, T., Zhang, L., Ye, D., Yu, S., and Zhou, W. (2026). Federated trustchain: Blockchain-enhanced llm training and unlearning. IEEE Transactions on Dependable and Secure Computing. DOI: 10.1109/tdsc.2026.3665277.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Roberto Gomes Ribeiro, Frederico Gadelha Guimarães, Hélder Seixas Lima, Vinicius Antonio de Oliveira Martins, Allana Tavares Bastos, Larissa Duarte Santana, Beatriz Camilly Gulart Pereira, Carla Beatriz Ferreira, Júlia Borba Fonseca de Souza, Melissa Costa Corrêa de Lima
This work is licensed under a Creative Commons Attribution 4.0 International License.
