UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Algorithms that remember: model inversion attacks and data protection law

Veale, M; Binns, R; Edwards, L; (2018) Algorithms that remember: model inversion attacks and data protection law. Philosophical Transactions A: Mathematical, Physical and Engineering Sciences , 376 (2133) , Article 20180083. 10.1098/rsta.2018.0083. Green open access

[thumbnail of Veale_Algorithms that Remember. Model Inversion Attacks and Data Protection Law_VoR.pdf]
Preview
Text
Veale_Algorithms that Remember. Model Inversion Attacks and Data Protection Law_VoR.pdf - Published Version

Download (469kB) | Preview

Abstract

Many individuals are concerned about the governance of machine learning systems and the prevention of algorithmic harms. The EU's recent General Data Protection Regulation (GDPR) has been seen as a core tool for achieving better governance of this area. While the GDPR does apply to the use of models in some limited situations, most of its provisions relate to the governance of personal data, while models have traditionally been seen as intellectual property. We present recent work from the information security literature around ‘model inversion’ and ‘membership inference’ attacks, which indicates that the process of turning training data into machine-learned systems is not one way, and demonstrate how this could lead some models to be legally classified as personal data. Taking this as a probing experiment, we explore the different rights and obligations this would trigger and their utility, and posit future directions for algorithmic governance and regulation.

Type: Article
Title: Algorithms that remember: model inversion attacks and data protection law
Open access status: An open access version is available from UCL Discovery
DOI: 10.1098/rsta.2018.0083
Publisher version: https://doi.org/10.1098/rsta.2018.0083
Language: English
Additional information: © 2018 The Authors. Published by the Royal Society under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/).
Keywords: model inversion, personal data, model trading, machine learning
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL SLASH
UCL > Provost and Vice Provost Offices > UCL SLASH > Faculty of Laws
URI: https://discovery.ucl.ac.uk/id/eprint/10052303
Downloads since deposit
154Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item