skip to main content
10.1145/3661725.3661762acmotherconferencesArticle/Chapter ViewAbstractPublication PagescmldsConference Proceedingsconference-collections
research-article

A Secure Enhancement Scheme for Interworking Privacy-Preserving Multi-Party Collaborative Modeling

Published: 20 June 2024 Publication History

Abstract

Multi-party collaborative modeling allows different participants to build machine learning models without revealing the local data. Federated Learning (FL) is currently the main technique to achieve multi-party collaborative modeling. However, FL faces a series of security and privacy issues (e.g., gradient leakage attacks). We present a new federated learning framework that incorporates fine-grained access control for privacy-preserving collaborative modeling by incorporating identity-based encryption (IBE), identity-based broadcast encryption (IBBE), and the trusted execution environment (TEE) technique. In this framework, participants are coordinated through a key generation center. Our framework enables secure broadcasting of the global parameters and fine-grained access control of the intermediate parameters during the FL process. Compared with prior FL frameworks, our framework does not require the communication channel to be secure and there is no additional key management overhead. Besides, in our framework, there is no need to establish a connection between the clients and server in advance. We conducted a series of experiments to prove that our solution is practical and efficient.

References

[1]
Naman Agarwal, Ananda Theertha Suresh, Felix Xinnan X Yu, Sanjiv Kumar, and Brendan McMahan. 2018. cpSGD: Communication-efficient and differentially-private distributed SGD. Advances in Neural Information Processing Systems 31 (2018).
[2]
Galen Andrew, Om Thakkar, Brendan McMahan, and Swaroop Ramaswamy. 2021. Differentially private learning with adaptive clipping. Advances in Neural Information Processing Systems 34 (2021), 17455–17466.
[3]
Yoshinori Aono, Takuya Hayashi, Lihua Wang, Shiho Moriai, 2017. Privacy-preserving deep learning via additively homomorphic encryption. IEEE transactions on information forensics and security 13, 5 (2017), 1333–1345.
[4]
Hanxiao Chen, Meng Hao, Hongwei Li, Kangjie Chen, Guowen Xu, Tianwei Zhang, and Xilin Zhang. 2023. GuardHFL: Privacy Guardian for Heterogeneous Federated Learning. In International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA(Proceedings of Machine Learning Research, Vol. 202), Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 4566–4584. https://proceedings.mlr.press/v202/chen23j.html
[5]
Kewei Cheng, Tao Fan, Yilun Jin, Yang Liu, Tianjian Chen, Dimitrios Papadopoulos, and Qiang Yang. 2021. Secureboost: A lossless federated learning framework. IEEE Intelligent Systems 36, 6 (2021), 87–98.
[6]
Cécile Delerablée. 2007. Identity-based broadcast encryption with constant size ciphertexts and private keys. In International Conference on the Theory and Application of Cryptology and Information Security. Springer, 200–215.
[7]
Yuyang Deng, Mohammad Mahdi Kamani, and Mehrdad Mahdavi. 2020. Adaptive personalized federated learning. arXiv preprint arXiv:2003.13461 (2020).
[8]
Hossein Fereidooni, Samuel Marchal, Markus Miettinen, Azalia Mirhoseini, Helen Möllering, Thien Duc Nguyen, Phillip Rieger, Ahmad-Reza Sadeghi, Thomas Schneider, Hossein Yalame, 2021. SAFELearn: Secure aggregation for private federated learning. In 2021 IEEE Security and Privacy Workshops (SPW). IEEE, 56–62.
[9]
Robin C Geyer, Tassilo Klein, and Moin Nabi. 2017. Differentially private federated learning: A client level perspective. arXiv preprint arXiv:1712.07557 (2017).
[10]
Stephen Hardy, Wilko Henecka, Hamish Ivey-Law, Richard Nock, Giorgio Patrini, Guillaume Smith, and Brian Thorne. 2017. Private federated learning on vertically partitioned data via entity resolution and additively homomorphic encryption. arXiv preprint arXiv:1711.10677 (2017).
[11]
Li Li, Yuxi Fan, Mike Tse, and Kuo-Yi Lin. 2020. A review of applications in federated learning. Computers & Industrial Engineering 149 (2020), 106854.
[12]
Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics. PMLR, 1273–1282.
[13]
Ekanut Sotthiwat, Liangli Zhen, Zengxiang Li, and Chi Zhang. 2021. Partially encrypted multi-party computation for federated learning. In 2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid). IEEE, 828–835.
[14]
Enayat Ullah, Christopher A. Choquette-Choo, Peter Kairouz, and Sewoong Oh. 2023. Private Federated Learning with Autotuned Compression. In International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA(Proceedings of Machine Learning Research, Vol. 202), Andreas Krause, Emma Brunskill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 34668–34708. https://proceedings.mlr.press/v202/ullah23b.html
[15]
Brent Waters. 2005. Efficient identity-based encryption without random oracles. In Advances in Cryptology–EUROCRYPT 2005: 24th Annual International Conference on the Theory and Applications of Cryptographic Techniques, Aarhus, Denmark, May 22-26, 2005. Proceedings 24. Springer, 114–127.
[16]
Ming Xie, Guodong Long, Tao Shen, Tianyi Zhou, Xianzhi Wang, Jing Jiang, and Chengqi Zhang. 2021. Multi-center federated learning. arXiv preprint arXiv:2108.08647 (2021).
[17]
Yue Zhao, Meng Li, Liangzhen Lai, Naveen Suda, Damon Civin, and Vikas Chandra. 2018. Federated learning with non-iid data. arXiv preprint arXiv:1806.00582 (2018).

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
CMLDS '24: Proceedings of the International Conference on Computing, Machine Learning and Data Science
April 2024
381 pages
ISBN:9798400716393
DOI:10.1145/3661725
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 June 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Collaborative modeling
  2. Federated learning
  3. Identity-based broadcast encryption
  4. Identity-based encryption

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • Big Data Center of State Grid Corporation of China

Conference

CMLDS 2024

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 14
    Total Downloads
  • Downloads (Last 12 months)14
  • Downloads (Last 6 weeks)0
Reflects downloads up to 09 Jan 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media