Data Protection Act and Anonymity

The current course I’m running through (Scalable Machine Learning) and other recent online courses (including Introduction to Big Data with Apache Spark) are amongst the many high-quality courses available on edX, Coursera, Udacity and so on. Prestigious universities offering free online courses so anyone can learn about advanced topics, not just in IT but in other subjects as well.

There is one disappointment with the current module, though. As it looks at click-through rates and notes that the source data has been anonymised, it’s obvious that while the technical side is being covered in good depth (covering the mathematical foundations, basic implementations, process for scaling to a distributed setup and the functions to use), there is far less coverage of the ethical and legal aspects. This is perhaps to be expected from such a short course (this course should be around 20-25 hours of study), However, a little more discussion would be good, if only enough to raise more awareness of the issues.

In legal terms, it may be easiest to set up moderately large-scale data processing in the cloud initially. It’s generally cheaper to run the servers in the US than in Europe. However, if you transferred personally identifiable data from Europe to the US then you risk falling foul of data protection legislation. What’s currently largely untested is what potential liability you have if supposedly depersonalised data proves to be sufficiently specific to identify individuals, but without touching on some of the basic ethical considerations about data privacy students may not be encouraged to find out their obligations or consider the rights and wrongs of this.

There is a point where personalisation could potentially become creepy or intrusive. If you searched for a pregnancy test, then you might not want to receive other pregnancy-related results – particularly on a shared computer which might make your condition apparent to others who you might not wish to tell yet. Similarly, targeting that may imply or show someone as having a stigmatised condition such as HIV, or lead to questions about sexual, religious or other views could in certain circumstances cause significant harm.

In the pursuit of better targetting, better classification, better modeling, we need to make sure that what we do is not just commercially justifiable but ethically and legally justifiable as well. Those of us who are registered professionals (of BCS or another recognised professional group) have an obligation in our professional code of conduct to operate in an ethical and legal manner. This means that we should raise awareness of these issues if they arise, and, if necessary, to refuse to perform work which is in breach of those standards.

I don’t take this view lightly, and have sought to raise legal concerns which have arisen in previous contracts. It’s not always easy. As a contractor without the protections of a permanent employee, that may mean risking your income to disagree with decision-makers. However, like an expectation to perform some pro bono work to provide service back to your community, our professional obligations aren’t just about what is best for us personally, but about what is honest and right. Many IT managers haven’t studied the legal and ethical concerns previously, so there is scope to raise these issues, generally.

As we make more and more use of the data we have available, we have to consider whether correct permission has been given for the use of the data in this way, whether it is being held in the correct locations, whether the correct access restrictions are in place, and what the correct response would be to a Freedom of Information request. These are just a few of the considerations. They apply not just when gathering the data, but in how it’s used, and if you look carefully, various advertising and personalisation systems offer options to only have more generic results and turn off the better personalisation. This should be an option available in your own site if you’re looking at something like recommendation systems based on past purchases or item views.

It’s a complex area, and the legal details go beyond my limited understanding of the legislation (I’m not a lawyer), but perhaps the ethical questions can be as much of a guide as the legal ones? Is this personal? Would I want my data used in this way? Am I acting for or against the best interests of the person or people whose data I’m analysing? Those are perhaps easier questions to answer without studying endless legislation, but no less important if you want to do things right.

129 thoughts on “Data Protection Act and Anonymity

  1. car insurance quotes

    f0I was very pleased to find this website. I wanted to thank you for your time for this wonderful post!! I definitely enjoy reading it and I have you bookmarked to check out new stuff you blog post.

    Reply
  2. car insurance quotes online

    Lisa: Awwww, thank you so much! My parents taught me that a garbage man and the president are equal. The difference is that the garbage man probably actually loves his wife and spends more time with his kids! What does page rank have to do with friendship anyway?

    Reply
  3. auto insurance

    Ja den søskenkjærligheten;) Heldigvis endrer det seg (som regel) når de får noen år på baken;)Flott knaggrekke, jeg er også svak for slike sinkhjerter;)Ha en flott helg!Klem!

    Reply
  4. insurance car

    Είναι από κάτι πιο έξυπνο, τα παίρνω για να τα γράφω. (2000€ τη λέξη, 1800€ αν είναι ανορθόγραφη). Θες να σε βάλω στην ομάδα;

    Reply
  5. car insurance

    You can certainly see your enthusiasm in the work you write. The arena hopes for more passionate writers such as you who aren’t afraid to mention how they believe. At all times go after your heart.

    Reply
  6. cheapest car insurance

    The only thing that would have made this build any cooler would been have if they built it in the kitchen while they were breast feeding someone. Let’s just say that someone is me. Once I’ve had dinner, I can go for a fun drive in my new Mustang!

    Reply
  7. car insurance quotes online

    me gustaria ver la demanda del 1-04-08 de ultimas cenas . tengo dos para ofrecer , en plata, de distinto tamaño. gracias.si la persona interesada quiere contactar conmigo dejar aqui mensaje.y gracias a este sitio..es muy practico

    Reply
  8. cheap auto insurance

    Infatti mi sono divertito quasi quanto prendere in contraddizione un testimone. Solo che questo è chiuso in ragionamenti circolari “ha ragione perché ha ragione” e dopo un po’ annoia.Se vuoi demolirlo un po’ anche tu fai pure, ma attento o farà un video di lui che ti picchia in un gioco di wrestling sulla consolle grazie per la solidarietÃ

    Reply
  9. insurance car

    Haha! My guess is the former. I trust Mr. Horne will explain that the foggy nature of Whitby, due to its location on a peninsula of Scotland or Madagascar or Bolivia, causes unwary tourists to mistake actual boats for overdecorated seafood restaurants. Those gangways are real! Use them!But who is CVC? I think it is a type of US aircraft carrier.

    Reply
  10. car insurance

    As we both know, when it comes to politics, what is obvious to someone with common sense, and what can be proven with a paper trail, can make all the difference. So yes, "plausible deniability" is greater with mercs than with agents, and sometimes more desirable. As with Columbia, it is absolutely forbidden for the US to call for a citizen to be assassinated, both by internal law and international law, but if a contracted strike force "took matters into their own hands" the government and the president are off the hook legally. Like it or not, it is happening every day.

    Reply
  11. http://carinsuranceratesway.info/cheap-car-insurance-for-oldham.html

    …og to ting til:1)Hva med mageøvelser? Tenker man at magen blir nok trent av de nevnte øvelsene? Er jo som de fleste (?) opptatt av en fresh mage, og lurer pÃ¥ om jeg kan/bør/skal snike inn noen mageøvelser, eller er dette bortkastet?2) NÃ¥r disse seks ukene har gÃ¥tt, er det Ã¥ begynne pÃ¥ uke 1 igjen, eller finne nye øvelser til treningsprogrammet sitt?

    Reply
  12. quote auto insurance

    17 mai 2012danyAm observat ca comentarile antiromanesti sunt facute de rusi. Nu ma mira ! Pentru ca ei sunt impotriva unirii celor doua state romanesti. Noi romanii trebuie sa fim mult mai curajosi si sa facem unirea !  

    Reply
  13. http://carinsurancequotestar.pw/ritchie-insurance-muncie.html

    Superb blog you’ve here yet I was curious if you knew involving any individual discussion community forums that cover exactly the same topics mentioned here? I’d like to be part of online local community where I’m able to get recommendations from some other experienced people that share the identical interest. If you have any suggestions, please let me know. Bless an individual!

    Reply
  14. free car insurance quotes

    04 jun 21, 2007 16:24 arraclan creo que lo has liado mas….aqui-no-hay-fotos-de-concha-velasco-desnuda/ te veo en el primer puesto en breve…jajajaja , vete buscando un patrocinador subido de tono que te forras… :P

    Reply
  15. http://autoinsurancesolo.pw/market-auto-insurance.html

    Thank you for your blog post. Jones and I have been saving to get a new e book on this subject and your short article has made people like us to save our own money. Your notions really clarified all our questions. In fact, above what we had thought of previous to the time we stumbled on your amazing blog. My spouse and i no longer have doubts as well as a troubled mind because you have clearly attended to each of our needs here. Thanks

    Reply
  16. car insurance

    Minua ei alun lievä verkkaisuus (ihme kyllä) haitannut yhtään. Juuri niin kuin kirjoitit, se loi sopivasti sellaista pikkuhiljaa hiipivää tunnelmaa. Ja tosiaan, loppua kohti vauhti kyllä yltyy. Uskon, että pidät! :)Muistaakseni tuo Kadonneet ilmestyy viikolla 34. Se vaikuttaa kyllä kiinnostavalta!

    Reply
  17. http://autoinsurancesolo.pw/insurance-auto-auctions-comr.html

    Believe me Rahul I have the greatest sympathy for those poor people in Africa, but what can I do singlehanded ?Of course they are exploited and that by their own leaders!sultana latifaonce an inhabitant of an Arab country. Thank you my God for taking us out a second time.I am now retiring for shabbat, because here where I live I am free to practise my religion!

    Reply
  18. http://carinsuranceratesway.info/how-to-buy-commercial-auto-insurance.html

    Walter I am astounded at you and your familys undertakings. You not only do things differently and succeed but you share your way so generously. All too many people like you by that I mean innovators are charging humungo dollars for weekend seminars. You on the otherhand freely share what you know. Your generousity is greatly appreciated. I have learned so much from your web site for making our farm better. Kudoz! If you ever write that rumored book I’m inline to buy it!

    Reply
  19. http://autoinsurancesolo.pw/acceptance-auto-insurance-jasper-al.html

    Soy “anónimo” por pura pereza.Y rebatiendo a algún post, no veo nada de ofensivo en describir la triste realidad.Opino que todos los movimientos totalitarios, ya se autodenominen “de derechas” (como el de Pinochet), “de izquierdas” (como el de Allende), o “teocráticos” (como el de Marruecos) son herramientas para la sistemática subyugación de los individuos a favor de la nomenclatura del momento.

    Reply
  20. http://gofreeautoinsurancequotes.com/teacher-discounts-on-car-insurance.html

    Les « Ã©normes cigares » de Lacan suffisaient à mettre la puce à l’oreille, quand on a vu, à la télévision, quels petits tuyaux (image à analyser) tirebouchonnés il pouvait fumer lors de ses séminaires (mot à analyser également).Les attaques dont il peut être encore à l’heure actuelle la victime facile et démagogique le font sans doute « fumer » – souterrainement – de manière humoristique (le « Witz », il connaît).

    Reply
  21. free car insurance quotes

    Grattis Steve! Själv har bloggat i nästan, kanske tom, fyra år och precis som du haft vissa perioder när jag ville sluta blogga. Men icke! Det ligger alldeles förnära hjärtat! Fint skrivet!

    Reply
  22. http://carinsuranceratesway.info/auto-insurance-rbc.html

    Jorge Andrés: siempre ha sido el gran sueño del hombre volar.Ana Michelle: sí de niño, se creen muchas cosas.Dante: cada quien puede interpretar la historia a su gusto. Bien puede ser como decís.Ray Roder: las aventuras infantiles se recuerdan siempre.Nicté: yo creo que los debe de haber, de hecho, hay gente viviendo en los barrancos. Juan-Antonio: la vida no es como sucedió, sino como la recordamos. Gracias por tus comentarios en los posts, especialmente por compartir la historia de tu mamá.

    Reply
  23. cheap auto insurance

    Does your site have a contact web page? I am having a tough schedule ruling it but, I would choose to appear you an e-mail. I’ve bought some concepts to your weblog you is perhaps complicated in inquiry. Equally manner, careful position and I put off up in support of seeing it expand more than time.

    Reply
  24. car insurance quotes

    Muchas gracias por tu comentario; la verdad este Blog no es de una sóla persona, sino de varias personas que conforman la Asamblea de Villa de Vallecas, es un trabajo en conjunto, donde cada integrante colabora estrechamente.Saludos,15M Asamblea Villa de Vallecas

    Reply
  25. http://simplycarinsurancequotes.com/cheap-auto-insurance-in-ny.html

    weekend break fun Just looking for a partner to pass time and weekend, enjoy each others company and become familiar with each other???. We, x’x”, physiy match, can host just about all weekend Absolutely no pressure, clean, unobtrus Married women flirting Duluth Minnesota ive, honest, willing to satisfy in person very first if this functions. Hit me up in c female hooker ase your are interested. Married women flirting Ethiopia sexy old women horny personals want swinger party

    Reply
  26. insurance auto quote

    To log into the game you do use your gamer’s first login.I do have a couple of lowbies that I can help people out on as well as my main Geistig. If you see Geistig or Sonja Blackheart online feel free to hit me up!

    Reply
  27. auto insurance

    Lima,sim é possível colocar o seu logótipo no cabeçalho.Você tem que editar o ficheiro header.php e colocar o código da imagem onde quer que ela apareça. Provavelmente terá que fazer algumas alterações no css também.Cumprimentos,Celso Azevedo

    Reply
  28. http://gofreeautoinsurancequotes.com/united-india-insurance-online-application-form.html

    dit :D’accord… tant mieux si Apple a le Ipod ou si Research In Motion a son Blackberry…. Mais comment peut-on justifier les profits des pétrolières?Quel profit ?Les pétrolière c’est seulement 7.6% de profit, loin derrière l’informatique, les télécoms, l’alimentation, les finances ou les médias !J’ose poser la question… la nationalisation pourquoi ça ne fait pas de sens?Ça déjà été essayé et ça raté.

    Reply
  29. http://autoinsurancesolo.pw/what-is-full-car-insurance-coverage.html

    She is so big and so cute! I love her big eyes. Saw your comment above. Since starting solids Raffi has been having bagno issues. I feel so bad for him. He’s not in pain but we don’t have any interesting diapers for days on end. I am giving only foods that should help him (pears, prunes, etc) but it still hasn’t changed.Anyway, can’t wait to take the ride of the food adventure with you and Livi! It is so much fun to see their funny expressions

    Reply
  30. cheap auto insurance

    Oh how I love you. It’s supposedly little things like that onesie that can end up bringing so many vivid memories. It can be tough to let go. Way to go on sending it to someone you know will use it! *hugs*

    Reply
  31. http://ridebikepass.com/construction-types-insurance.html

    hola andrés,muchas gracias por tu comentario. me alegro que te hayan gustado las recetas (y que te hayan salido tan bien como dices!)puedes encontrar hojas de lima kefir en gral margallo (las venden congeladas), lo que no vas a poder encontrar en españa son las limas.fenogreco… probablemente lo encuentres también en lavapiés y seguramente herbolisteríasalessia,muchas gracias por tus alagos!… hasta pronto!

    Reply
  32. http://threadsofthecity.com/cheapest-car-insurance-for-students.html

    Adel قال:الكاميرا شيء أساسي بالهاتف بالنسبة لي و أعتقد من هذه الناحية لاشيء يتفوق على LUMIA 920 و الآن نظام مايكروسوفت أصبح أكثر نضوجا و هواتف الويندوز فون أصبحت تمتلك مواصفات قوية و مغرية .

    Reply
  33. cheap auto insurance

    a document is official, every other state plus the federal government will accept it as official.I would never vote for Obama if he was the only name on the ballot, but the Full faith and credit clause is there for all to read in Article IV, Section 1 and if anyone is going to challenge the validity of Obama's birth certificate in a Court of Law and win, that is what they must confront: Official statements across two different administrations of two different political parties.

    Reply
  34. auto insurance quotes

    The first piece is certainly an important social message, that simply doesn’t get in folks’ faces enough. Well done to those who produced this, and to you as spokesperson for the message!

    Reply
  35. http://grailsbaku.com/eating-while-driving-statistics.html

    Thanks a bunch, Amber!I’ve picked up a couple of cookbooks and looked at the Vegan blog. It has been a great help, I have also tried your 5 min. blondie fix, and it was really good, sweet and super rich! i almost couldn’t finish it and was amazed at the complex flavors that was brought out with such a simple dish. You will definitely here more from me!

    Reply
  36. http://bethsanchez.net/swift-cover-car-insurance-phone-number.html

    वटवृक्ष की घनी छाँव में खुद को पाकर बहुत अच्छा लगा… कवि मन की ऊँगली थामे-कभी यहाँ,कभी वहांएक ही क्षण में धरती से आकाशआकाश से धरतीकहाँ – कहाँ नहीं जाते हैं हम… बहुत-बहुत आभार…

    Reply
  37. http://threadsofthecity.com/does-insurance-cover-braces-a-second-time.html

    The very core of your writing while sounding agreeable initially, did not really work well with me personally after some time. Someplace throughout the paragraphs you actually were able to make me a believer unfortunately only for a while. I however have got a problem with your leaps in assumptions and you might do nicely to fill in those breaks. In the event that you actually can accomplish that, I could certainly end up being fascinated.

    Reply
  38. car insurance quotes

    Comentario by ALTURO GOMEZ — SOY EMCEPRESARIO Y TENGO MAS DE 180 TRABAJADORES PAGO MENSUAL MENTE UNOS 60.000 € DE SEGURIDAD SOCIAL SI UN MES NO PUEDO PAGAR QUE VOY A LA CARCEL POR SEIS AÑOS.PUES ESTA BIEN TENDREMOS QUE REDUSIR PLANTILLA SR DEL PP.

    Reply
  39. auto insurance quotes

    JMK: Haha they don't trust your judgement of clubs as being "normal". We went to Bed Supperclub though!Anonymous: Citadines Bangkok! There's a few branches, not sure what this one is called but it's at Sukhamvit 16

    Reply
  40. http://bethsanchez.net/small-farm-insurance.html

    eek! hope butter is recovering well from surgery. (i almost typed sugary)i hear you on worrying over the pump malfunctions. the good news is that you powered through this one successfully so if it happens again it won’t be as frustrating (maybe. hopefully). i wish i had good cgm advice for you but as you might recall, similar to WBB, L does not like to wear hers at all (though it’s not a dexcom and those are supposed to be easier to wear than the mm that L has).ANYWAY. so glad to hear dream babysitter is feeling better and back in action!

    Reply
  41. car insurance quotes

    Does anyone know how long a ‘Google Image Search’ takes to pick up the 301 redirect.The ‘Standard’ search results seem to have picked up the move without any noticeable penalty – but all my images have disappeared!

    Reply
  42. car insurance quote

    I love these shots of you Vix, you look so happy!I think i may actually have suffered mud and rain too if it were to see the awesome Flamin LipsThat pic of you snuggled up is adorablexx

    Reply
  43. http://ridebikepass.com/no-car-insurance-in-canada.html

    je suis contente que ça soit bien déroulé… J’adore l’ambiance du bloc, les inf’ ont toujours beaucoup d’humour… je suppose que ton stérilet est partie en vadrouille!!!Pour le polype, souvent c’est bénin, mais il faut néanmoins faire un recontrôle pour éviter de passer à côté d’un éventuel Papilloma virus qui peut aboutir sur un cancer de col… Donc, la prudence est de mise.Bon repos !

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>