I have just read a fascinating article describing how political campaigns, most recently the Trump campaign, use the internet, social media, AI, and related technologies to target and influence voters. Assuming its account is accurate, what it is describing is what political campaigns have long done, just doing it better. It is a normal part of campaigning to try to target ads and campaign speeches to particular groups of voters, telling each group what the campaign believes its members will find most convincing. The difference is the granularity.
This time they have it down to the individual voter.
The first step is to get information about voters at the individual level. Facebook provides one way of doing so, by looking at what people and pages each individual likes, along with the information individuals report about themselves. From that, deduce as much as you can about personality, beliefs, all of the things that will make one argument more persuasive than another. Target each individual with the campaign ads you think will persuade him. Watch what ads each person clicks on and use that feedback to steadily refine the model, improving both your information about what sort of person he is and about what sorts of ads work with that sort of person.
That approach to persuading voters is no more dishonest than conventional campaigning, just better done. Indeed, one might argue that part of what it is doing is reversing the effect of earlier technological change. In the world of 19th century whistle stop campaigns, where most of what you knew about a candidate was what you or your friends had actually heard him say, candidates could and did tell different stories to different groups of voters. The rise of national media made that harder to get away with. The speech telling farmers that, if elected, you would do all you could to keep crop prices high might be less persuasive to urban voters who read about it in the newspaper, heard it on the radio, saw it on television.
But now, through the power of newer technologies, you can not only tell farmers you are particularly concerned with their problems without anyone else overhearing the conversation, you can target your ads to sugar beet farmers in North Dakota. And you can vary the particular version of the ad according to what sort of argument each individual farmer finds most compelling, as reflected in which ads he reads and shares as well as the information deduced from his other online activities.
So far, it is merely conventional targeting done better. The anonymity of online conversation adds another tool for persuasion—fictional identities. The technique is familiar from online arguments where three of the four people supporting a position may be sockpuppets of the fourth. Done on a professional scale, the hundred people arguing for a position, insulting opponents, praising supporters, may be three people in one office.
It is an interesting article and worth reading for a more detailed account of the technology. The author obviously has his own axe to grind, since he believes that at the moment the leading practitioners of the new dark art are working for the wrong side; he makes what he is describing sound more sinister than it actually is, most of it being simply new and better versions of ancient tricks.
As he makes clear, it is a technology that could be used for any political cause. It could also be used for non-political causes, and is. Presidential elections are every four years, but people are always buying and selling. Technologies that tell a political campaign what arguments will persuade a voter to vote for their candidate can as well be used to persuade a buyer to buy what the seller is selling.
Seen from this standpoint I find the technology considerably less sinister. It is true that it can be used to produce bogus praise for products from fictional users, but I already knew that and discount such praise accordingly, more heavily the more it feels like something that could have been churned out by a computer program. But it can also be used to try to sell me the sorts of things that I want to buy. I would much rather receive emailed ads for opal rough on ebay—one of my hobbies is lapidary work—than be interrupted at dinner by a phone call from someone trying to persuade me to refinance my nonexistent mortgage.