Abstract: With the continuous development of data mining, the information hidden within data can bring immense value across various fields, but there is always the risk of user sensitive information leakage when using the model for prediction. Aiming at the problem of sensitive data leakage in the training process of neural networks, this paper proposed an improved BP neural network algorithm with differential and dual privacy protection, named BPDDP. In this method, the difference privacy theory was introduced in the process of network training, and Gaussian noise conforming to a certain privacy budget was added to the loss function, and Laplace noise was added after the gradient is corrected, so as to achieve privacy protection. Finally, the experiment is compared with the traditional BP neural network. The experimental results show that the BP neural network still has good multiclassification performance under the premise of privacy protection when the added noise scale is small.

Key words: BP neural network, Gaussian mechanism, loss function, Laplace mechanism, double differential privacy

摘要： 随着数据挖掘技术的不断发展,数据中潜藏的信息可以给各个领域带来巨大的价值，但利用模型进行预测时往往存在用户敏感信息泄露的风险.针对神经网络在训练过程中所存在的敏感数据泄露问题，提出了一种具有双重差分隐私保护的BP神经网络改进算法BPDDP.该算法在网络训练过程中引入差分隐私理论，对损失函数添加符合一定隐私预算的高斯噪声，并在对梯度进行修正后添加Laplace噪声，从而实现隐私保护，最后与传统的BP神经网络进行对比实验. 实验结果表明，当添加噪声规模较小时，BP神经网络在保护隐私前提下仍然具有较好的多分类性能.

关键词: BP神经网络, 高斯机制, 损失函数, Laplace机制, 双重差分隐私