Polling may never have been less reliable, or more influential, than it is now.CREDIT
ILLUSTRATION BY MATT CHASE
“I am who I am,” Donald J. Trump said in August, on the eve of this season’s first G.O.P. Presidential debate, and what he meant by that was this: “I don’t have a pollster.” The word “pollster,” when it was coined, was meant as a slur, like “huckster.” That’s the way Trump uses it. Other candidates have pollsters: “They pay these guys two hundred thousand dollars a month to tell them, ‘Don’t say this, don’t say that.’ ” Trump has none: “No one tells me what to say.”
Every election is a morality play. The Candidate tries to speak to the People but is thwarted by Negative Campaigning, vilified by a Biased Media, and haunted by a War Record. I am who I am, the Candidate says, and my Opponents are flunkies. Trump makes this claim with unrivalled swagger, but citing his campaign’s lack of a pollster as proof of his character, while fascinating, is utterly disingenuous. The Path to Office is long. To reach the Land of Caucuses and Primaries, the Candidate must first cross the Sea of Polls. Trump is a creature of that sea.
Lately, the Sea of Polls is deeper than ever before, and darker. From the late nineteen-nineties to 2012, twelve hundred polling organizations conducted nearly thirty-seven thousand polls by making more than three billion phone calls. Most Americans refused to speak to them. This skewed results. Mitt Romney’s pollsters believed, even on the morning of the election, that Romney would win. A 2013 study—a poll—found that three out of four Americans suspect polls of bias. Presumably, there was far greater distrust among the people who refused to take the survey.
The modern public-opinion poll has been around since the Great Depression, when the response rate—the number of people who take a survey as a percentage of those who were asked—was more than ninety. The participation rate—the number of people who take a survey as a percentage of the population—is far lower. Election pollsters sample only a minuscule portion of the electorate, not uncommonly something on the order of a couple of thousand people out of the more than two hundred million Americans who are eligible to vote. The promise of this work is that the sample is exquisitely representative. But the lower the response rate the harder and more expensive it becomes to realize that promise, which requires both calling many more people and trying to correct for “non-response bias” by giving greater weight to the answers of people from demographic groups that are less likely to respond. Pollster.com’s Mark Blumenthal has recalled how, in the nineteen-eighties, when the response rate at the firm where he was working had fallen to about sixty per cent, people in his office said, “What will happen when it’s only twenty? We won’t be able to be in business!” A typical response rate is now in the single digits.
Meanwhile, polls are wielding greater influence over American elections than ever. In May, Fox News announced that, in order to participate in its first prime-time debate, hosted jointly with Facebook, Republican candidates had to “place in the top ten of an average of the five most recent national polls.” Where the candidates stood on the debate stage would also be determined by their polling numbers. (Ranking in the polls had earlier been used to exclude third-party candidates.) Scott Keeter, Pew’s director of survey research, is among the many public-opinion experts who found Fox News’s decision insupportable. “I just don’t think polling is really up to the task of deciding the field for the headliner debate,” Keeter told me. Bill McInturff doesn’t think so, either. McInturff is a co-founder of Public Opinion Strategies, the leading Republican polling organization; with its Democratic counterpart, Hart Research Associates, he conducts the NBC News/Wall Street Journal poll. “I didn’t think my job was to design polling so that Fox could pick people for a debate,” McInturff told me. Really, it’s not possible to design a poll to do that.
Even if more people could be persuaded to answer the phone, polling would still be teetering on the edge of disaster. More than forty per cent of America’s adults no longer have landlines, and the 1991 Telephone Consumer Protection Act bans autodialling to cell phones. (The law applies both to public-opinion polling, a billion-dollar-a-year industry, and to market research, a twenty-billion-dollar-a-year industry.) This summer, Gallup Inc agreed to pay twelve million dollars to settle a class-action lawsuit filed on behalf of everyone in the United States who, between 2009 and 2013, received an unbidden cell-phone call from the company seeking an opinion about politics. (Gallup denies any wrongdoing.) In June, the F.C.C. issued a ruling reaffirming and strengthening the prohibition on random autodialling to cell phones. During congressional hearings, Greg Walden, a Republican from Oregon, who is the chair of the House Subcommittee on Communications and Technology, asked F.C.C. chairman Tom Wheeler if the ruling meant that pollsters would go “the way of blacksmiths.” “Well,” he said, “they have been, right?”
Internet pollsters have not replaced them. Using methods designed for knocking on doors to measure public opinion on the Internet is like trying to shoe a horse with your operating system. Internet pollsters can’t call you; they have to wait for you to come to them. Not everyone uses the Internet, and, at the moment, the people who do, and who complete online surveys, are younger and leftier than people who don’t, while people who have landlines, and who answer the phone, are older and more conservative than people who don’t. Some pollsters, both here and around the world, rely on a combination of telephone and Internet polling; the trick is to figure out just the right mix. So far, it isn’t working. In Israel this March, polls failed to predict Benjamin Netanyahu’s victory. In May in the U.K., every major national poll failed to forecast the Conservative Party’s win.
“It’s a little crazy to me that people are still using the same tools that were used in the nineteen-thirties,” Dan Wagner told me when I asked him about the future of polling. Wagner was the chief analytics officer on the 2012 Obama campaign and is the C.E.O. of Civis Analytics, a data-science technology and advisory firm. Companies like Civis have been collecting information about you and people like you in order to measure public opinion and, among other things, forecast elections by building predictive models and running simulations to determine what issues you and people like you care about, what kind of candidate you’d give money to, and, if you’re likely to turn out on Election Day, how you’ll vote. They might call you, but they don’t need to.
Still, data science can’t solve the biggest problem with polling, because that problem is neither methodological nor technological. It’s political. Pollsters rose to prominence by claiming that measuring public opinion is good for democracy. But what if it’s bad?
A “poll” used to mean the top of your head. Ophelia says of Polonius, “His beard as white as snow: All flaxen was his poll.” When voting involved assembling (all in favor of Smith stand here, all in favor of Jones over there), counting votes required counting heads; that is, counting polls. Eventually, a “poll” came to mean the count itself. By the nineteenth century, to vote was to go “to the polls,” where, more and more, voting was done on paper. Ballots were often printed in newspapers: you’d cut one out and bring it with you. With the turn to the secret ballot, beginning in the eighteen-eighties, the government began supplying the ballots, but newspapers kept printing them; they’d use them to conduct their own polls, called “straw polls.” Before the election, you’d cut out your ballot and mail it to the newspaper, which would make a prediction. Political parties conducted straw polls, too. That’s one of the ways the political machine worked.
Straw polls were usually conducted a few days or weeks before an election. This August, to cull the field for the first G.O.P. debate, Fox News used polls conducted more than four hundred and sixty days before the general election. (These early polls have become so unreliable that neither Gallup nor Pew conducts them.) The question asked ordinarily takes the form of “If the election were held tomorrow . . .” The circumstances under which the next U.S. Presidential election would actually be held tomorrow involve, essentially, Armageddon. Trump won. All flaxen was his poll.
A century ago, newspapers that wanted to predict the outcome of a Presidential election had to join forces. In 1908, the New York Herald, the Cincinnati Enquirer, the Chicago Record-Herald, and the St. LouisRepublic tallied their straws together. William Randolph Hearst’s newspapers did the same thing. But the best predictions were made by a national magazine, the Literary Digest, beginning in 1916. It regularly miscalculated the popular vote, but for a long time it got the Electoral College winner right. In 1920, the Digest mailed out eleven million ballots. By 1932, its mailing list had swelled to twenty million. Most of those names were taken from telephone directories and automobile-registration files. George Gallup was one of the few people who understood that the Digest risked underestimating Democratic votes, especially as the Depression deepened, because its sample, while very big, was not very representative: people who supported F.D.R. were much less likely than the rest of the population to own a telephone or a car.
Gallup was borrowing from the insights of social science. Social surveys, first conducted in the eighteen-nineties, had been a hallmark of Progressive Era social reform. In 1896, W. E. B. Du Bois went door to door in Philadelphia’s Seventh Ward and interviewed some five thousand people in order to prepare his study “The Philadelphia Negro.” In the nineteen-thirties, social scientists argued for the merits of a shortcut that relied on statistical science: surveying a tiny but representative sample of a population.
Gallup had always wanted to be a newspaper editor, but after graduating from the University of Iowa, in 1923, he entered a Ph.D. program in applied psychology. In 1928, in a dissertation called “An Objective Method for Determining Reader Interest in the Content of a Newspaper,” Gallup argued that “at one time the press was depended upon as the chief agency for instructing and informing the mass of people” but that newspapers no longer filled that role and instead ought to meet “a greater need for entertainment.” He therefore devised a method: he’d watch readers go through a newspaper column by column and mark up the parts they liked, so that he could advise an editor which parts of the paper to keep printing and which parts to scrap.
In 1932, when Gallup was a professor of journalism at Northwestern, his mother-in-law, Ola Babcock Miller, ran for secretary of state in Iowa. Her late husband had run for governor; her nomination was largely honorary and she was not expected to win. Gallup had read the work of Walter Lippmann. Lippmann believed that “public opinion” is a fiction created by political élites to suit and advance their interests. Gallup disagreed, and suspected that public opinion, like reader interest, could be quantified. To get a sense of his mother-in-law’s chances, Gallup began applying psychology to politics. The year of the race (she won), Gallup moved to New York, and began working for an advertising agency while also teaching at Columbia and running an outfit he called the Editors’ Research Bureau, selling his services to newspapers. Gallup thought of this work as “a new form of journalism.” But he decided that it ought to sound academic, too. In 1935, in Princeton, he founded the American Institute of Public Opinion, with funding provided by more than a hundred newspapers.
In 1936, in his syndicated column Gallup predicted that the Literary Digest would calculate that Alf Landon would defeat F.D.R. in a landslide and that the Digest would be wrong. He was right on both counts. This was only the beginning. “I had the idea of polling on every major issue,” Gallup explained. He began insisting that this work was essential to democracy. Elections come only every two years, but “we need to know the will of the people at all times.” Gallup claimed that his polls had rescued American politics from the political machine and restored it to the American pastoral, the New England town meeting. Elmo Roper, another early pollster, called the public-opinion survey “the greatest contribution to democracy since the introduction of the secret ballot.”
Gallup’s early method is known as “quota sampling.” He determined what proportion of the people are men, women, black, white, young, and old. The interviewers who conducted his surveys had to fill a quota so that the population sampled would constitute an exactly proportionate mini-electorate. But what Gallup presented as “public opinion” was the opinion of Americans who were disproportionately educated, white, and male. Nationwide, in the nineteen-thirties and forties, blacks constituted about ten per cent of the population but made up less than two per cent of Gallup’s survey respondents. Because blacks in the South were generally prevented from voting, Gallup assigned no “Negro quota” in those states. As the historian Sarah Igo has pointed out, “Instead of functioning as a tool for democracy, opinion polls were deliberately modeled upon, and compounded, democracy’s flaws.”
Ever since Gallup, two things have been called polls: surveys of opinions and forecasts of election results. (Plenty of other surveys, of course, don’t measure opinions but instead concern status and behavior: Do you own a house? Have you seen a doctor in the past month?) It’s not a bad idea to reserve the term “polls” for the kind meant to produce election forecasts. When Gallup started out, he was skeptical about using a survey to forecast an election: “Such a test is by no means perfect, because a preelection survey must not only measure public opinion in respect to candidates but must also predict just what groups of people will actually take the trouble to cast their ballots.” Also, he didn’t think that predicting elections constituted a public good: “While such forecasts provide an interesting and legitimate activity, they probably serve no great social purpose.” Then why do it? Gallup conducted polls only to prove the accuracy of his surveys, there being no other way to demonstrate it. The polls themselves, he thought, were pointless.
Donald Trump doesn’t have a campaign pollster, but, while he was leading them, his campaign loved polls. Polls admitted Trump into the first G.O.P. debate and polls handed him a victory. “Donald J. Trump Dominates Time Poll,” the Trump campaign posted on its Web site following the August debate, linking to a story in which Time reported that forty-seven per cent of respondents said that Trump had won. Time’s “poll” was conducted by PlayBuzz, a viral-content provider that embeds quizzes, polls, lists, and other “playful content” items onto Web sites to attract traffic. PlayBuzz collected more than seventy-seven thousand “votes” from visitors to Time’s Web site in its instant opt-in Internet poll. Timeposted a warning: “The results of this poll are not scientific.”
Because most polls do not come with warnings, many reporters and news organizations have been trying to educate readers about polling methods. The day after the first G.O.P. debate, Slate published a column called “Did Trump Actually Win the Debate? How to Understand All Those Instant Polls That Say Yes.” This, though, didn’t stop Slate from conducting its own instant poll. “TV talking heads won’t decide this election,” Slate’s pollster promised. “The American people will.”
The statistician Nate Silver began explaining polls to readers in 2008; the Times ran his blog, FiveThirtyEight, for four years. Silver makes his own predictions by aggregating polls, giving greater weight to those which are more reliable. This is helpful, but it’s a patch, not a fix. The distinction between one kind of poll and another is important, but it is also often exaggerated. Polls drive polls. Good polls drive polls and bad polls drive polls, and when bad polls drive good polls they’re not so good anymore.
Laws govern who can run for office and how. There are laws about who can vote, and where, and when. Seven constitutional amendments and countless Supreme Court cases concern voting. But polls are largely free from government regulation, or even scrutiny. (This is not true in other countries; Canadian election law, for instance, regulates the disclosure of election polls.)
This wasn’t always the case. In the nineteen-thirties and forties, motions were regularly introduced in Congress calling for an investigation into the influence of public-opinion polling on the political process. “These polls are a racket, and their methods should be exposed to the public,” Walter Pierce, a Democratic member of the House, wrote in 1939, the year Time first called George Gallup a “pollster.” One concern was that polls were jury-rigged. In the Presidential election of 1944, George Gallup underestimated Democratic support in two out of three states. When Congress called him in for questioning to answer the charge that “the Gallup poll was engineered in favor of the Republicans,” Gallup explained that, anticipating a low turnout, he had taken two points off the projected vote for F.D.R. In another instance, a congressman voiced concern that polls “are in contradiction to representative government”: pollsters appeared to believe that the United States is or ought to be a direct democracy.
Social scientists began criticizing pollsters, too. In 1947, in an address to the American Sociological Association, Herbert Blumer argued that public opinion does not exist, absent its measurement. Pollsters proceed from the assumption that “public opinion” is an aggregation of individual opinions, each given equal weight—an assumption Blumer demonstrated to be preposterous, since people form opinions “as a function of a society in operation.” We come to hold and express our opinions in conversation, and especially in debate, over time, and different people and groups influence us, and we them, to different degrees.
Gallup got his back up. In 1948, the week before Election Day, he said, “We have never claimed infallibility, but next Tuesday the whole world will be able to see down to the last percentage point how good we are.” He predicted that Dewey would beat Truman. He was quite entirely wrong.
Gallup liked to say that pollsters take the “pulse of democracy.” “Although you can take a nation’s pulse,” E. B. White wrote after the election, “you can’t be sure that the nation hasn’t just run up a flight of stairs.”
In the wake of polling’s most notorious failure, the political scientist Lindsay Rogers published a book called “The Pollsters: Public Opinion, Politics, and Democratic Leadership.” Rogers, the Burgess Professor of Public Law at Columbia, had started out as a journalist and, as a scholar, he was a humanist at a time when most students of government had turned away from the humanities and toward social science. (Amy Fried, in an essay about what was lost in that abandonment, has called him “the Forgotten Lindsay Rogers.”) He had drafted “The Pollsters” before the election debacle; his concern had very little to do with miscalculation. Where Blumer argued that polling rests on a misapplication of social science, Rogers argued that it rests on a misunderstanding of American democracy. Even if public opinion could be measured (which Rogers doubted), he believed that legislators’ use of polls to inform their votes would be inconsistent with their constitutional duty. The United States has a representative government for many reasons, among them that it protects the rights of minorities against the tyranny of a majority. “The pollsters have dismissed as irrelevant the kind of political society in which we live and which we, as citizens, should endeavor to strengthen,” Rogers wrote. Polls, Rogers believed, are a majoritarian monstrosity.
The alarms raised by Blumer and Rogers went unheeded. Instead, many social scientists came to believe that, if the pollsters failed, social science would fail with them (not least by losing foundation and federal research money). Eight days after Truman beat Dewey, the Social Science Research Council appointed an investigative committee, explaining that “extended controversy regarding the pre-election polls among lay and professional groups might have extensive and unjustified repercussions upon all types of opinion and attitude studies and perhaps upon social science research generally.” The committee concluded that the problem was, in part, quota sampling, but, in any case, the main work of the report was to defend the sample-survey method, including a landmark project founded at the University of Michigan in 1948, which became the most ambitious and most significant survey of American voters: the American National Election Survey.
In 1952, Eisenhower unexpectedly defeated Stevenson. “Yesterday the people surprised the pollsters, the prophets, and many politicians,” Edward R. Murrow said on CBS Radio. “They are mysterious and their motives are not to be measured by mechanical means.” But politicians don’t want the people to be mysterious. Soon, not only political candidates but officeholders—including Presidents—began hiring pollsters. Meanwhile, pollsters claim to measure opinions as elusive as Americans’ belief in God, as the sociologist Robert Wuthnow points out in a compelling and disturbing new book, “Inventing American Religion: Polls, Surveys, and the Tenuous Quest for a Nation’s Faith.” In 1972, when Congress debated a Truth-in-Polling Act, longtime pollsters like Gallup attempted to distance themselves from campaign and media pollsters. Called to testify, Gallup supported the bill, objecting only to the requirement that pollsters report their response rates. That same year, in “Public Opinion Does Not Exist,” the French sociologist Pierre Bourdieu revisited arguments made by Herbert Blumer. As these and other critics have demonstrated again and again, a sizable number of people polled either know nothing about the matters those polls purport to measure or hold no opinion about them. “The first question a pollster should ask,” the sociologist Leo Bogart advised in 1972, is “ ‘Have you thought about this at all? Do you have an opinion?’ ”
Despite growing evidence of problems known as non-opinion, forced opinion, and exclusion bias, journalists only relied on Gallup-style polling more, not less, and they began, too, to do it themselves. In 1973, in “Precision Journalism,” Philip Meyer urged reporters to conduct their own surveys: “If your newspaper has a data-processing department, then it has key-punch machines and people to operate them.” Two years later, the Times and CBS released their first joint poll, and we’ve been off to the races ever since, notwithstanding the ongoing concerns raised by critics who point out, as has Gallup Poll’s former managing editor David Moore, that “media polls give us distorted readings of the electoral climate, manufacture a false public consensus on policy issues, and in the process undermine American democracy.” Polls don’t take the pulse of democracy; they raise it.
By the end of August, Trump, faltering, revealed that he is of course obsessed with his standing in the polls. “I won in every single poll of the debate,” he boasted. “I won in Timemagazine.” Trump’s lead in the polls had taken so many political reporters by surprise that some people who cover polls—“data journalists” is, broadly, the term of art—began turning to data-science firms like Civis Analytics, wondering whether they, too, saw Trump in the lead.
If public-opinion polling is the child of a strained marriage between the press and the academy, data science is the child of a rocky marriage between the academy and Silicon Valley. The term “data science” was coined in 1960, one year after the Democratic National Committee hired Simulmatics Corporation, a company founded by Ithiel de Sola Pool, a political scientist from M.I.T., to provide strategic analysis in advance of the upcoming Presidential election. Pool and his team collected punch cards from pollsters who had archived more than sixty polls from the elections of 1952, 1954, 1956, 1958, and 1960, representing more than a hundred thousand interviews, and fed them into a UNIVAC. They then sorted voters into four hundred and eighty possible types (for example, “Eastern, metropolitan, lower-income, white, Catholic, female Democrat”) and sorted issues into fifty-two clusters (for example, foreign aid). Simulmatics’ first task, completed just before the Democratic National Convention, was a study of “the Negro vote in the North.” Its report, which is thought to have influenced the civil-rights paragraphs added to the Party’s platform, concluded that between 1954 and 1956 “a small but significant shift to the Republicans occurred among Northern Negroes, which cost the Democrats about 1 per cent of the total votes in 8 key states.” After the nominating convention, the D.N.C. commissioned Simulmatics to prepare three more reports, including one that involved running simulations about different ways in which Kennedy might discuss his Catholicism.
In 1964, a political scientist named Eugene Burdick wrote a novel called “The 480,” about the work done by Simulmatics. He was worried about its implications:
There is a benign underworld in American politics. It is not the underworld of cigar-chewing pot-bellied officials who mysteriously run “the machine.” Such men are still around, but their power is waning. They are becoming obsolete though they have not yet learned that fact. The new underworld is made up of innocent and well-intentioned people who work with slide rules and calculating machines and computers which can retain an almost infinite number of bits of information as well as sort, categorize, and reproduce this information at the press of a button. Most of these people are highly educated, many of them are Ph.D.s, and none that I have met have malignant political designs on the American public. They may, however, radically reconstruct the American political system, build a new politics, and even modify revered and venerable American institutions—facts of which they are blissfully innocent. They are technicians and artists; all of them want, desperately, to be scientists.
Burdick’s dystopianism is vintage Cold War: the Strangelovian fear of the machine. (Burdick also co-wrote “Fail Safe,” in which a computer error triggers a nuclear war.) But after 1960 the D.N.C. essentially abandoned computer simulation. One reason may have been that L.B.J. wasn’t as interested in the work of M.I.T. scientists as Kennedy had been. For decades, Republicans were far more likely than Democrats to use computer-based polling. In 1977, the R.N.C. acquired a mainframe computer, while the D.N.C. got its own mainframe in the eighties. The political scientist Kenneth Janda speculates that the technological advantage of the Republican Party during these years stemmed from its ties to big business. Democratic technological advances awaited the personal computer; the R.N.C. is to I.B.M. as the D.N.C. is to Apple. Then came the Internet, which, beginning with the so-called MoveOn effect, favored Democrats but, as Matthew Hindman argued in “The Myth of Digital Democracy,” has not favored democracy.
Douglas Rivers is a professor of political science at Stanford who is also the chief scientist at YouGov. He started trying to conduct public-opinion surveys via the Internet in the nineties, and has done much of the best and most careful work in the field. When he co-founded Knowledge Networks and conducted polls through Web TV, he used probability sampling as an alternative to quota sampling. The initial response rate was something like fifty per cent, but over time the rate fell into the single digits. Then came the Internet crash. “We slimmed down,” Rivers told me when I visited him in Palo Alto. “I went back to teaching.”
Rivers then started a company called Polimetrix, which he sold to YouGov for an estimated thirty-five million dollars. There he developed a method called “matched sampling”: he uses the U.S. Census Bureau’s American Community Survey, which surveys a million people a year, to generate a random sample according to “fifteen variables of representativeness” and to determine who will participate in polls. “You get a million people to take the poll, but you only need a thousand, so you pick the thousand that match your target population,” he explained to me.
Sometimes when political scientists are hired by corporations their research becomes proprietary. “When I say I don’t know the secret sauce, I really don’t know it,” Arthur Lupia says of political scientists who sell their research to businesses rather than publish it in journals that would require them to reveal their methodologies. Lupia is a professor of political science at the University of Michigan, a former director of the American National Election Survey, and the lead author of “Improving Public Perceptions of Political Science’s Value,” a 2014 report prepared by a task force established by the American Political Science Association. Where once social scientists avidly defended the polling industry, many have grown alarmed that media-run horse-race polls may be undermining the public’s perception of the usefulness of social-science surveys. (Lupia jokes that horse-race polls ought to have a warning label that reads “For entertainment purposes only.”) Like Rivers, Lupia ardently believes in the importance of measuring public opinion. “It is critical for a nation that cherishes its democratic legitimacy to seek credible measures of how citizens think, feel, and act in electoral contexts,” Lupia and the political scientist Jon Krosnick have written. Otherwise, “there will be no strong evidentiary basis for differentiating propagandistic tall tales from empirically defensible and logically coherent readings of electoral history.”
It’s an important point. But it may be that media-run polls have endangered the academic study of public opinion and of political behavior. Public disaffection with the polling industry has contributed to a plummeting response rate for academic and government surveys.
Those surveys are invaluable, the political scientist Sidney Verba has argued. “Surveys produce just what democracy is supposed to produce—equal representation of all citizens,” Verba said in a presidential address before the American Political Science Association in 1995. “The sample survey is rigorously egalitarian; it is designed so that each citizen has an equal chance to participate and an equal voice when participating.” Verba sees surveying public opinion not only as entirely consistent with democratic theory but as a corrective to democracy’s flaws. Surveys, Verba argues, achieve representativeness through science.
The best and most responsible pollsters, whether Democratic, Republican, or nonpartisan, want nothing so much as reliable results. Today, with a response rate in the single digits, they defend their work by pointing out that the people who do answer the phone are the people who are most likely to vote. Bill McInturff, of Public Opinion Strategies, told me, “The people we have trouble getting are less likely to vote.” But the difficulty remains. Surveying only likely voters might make for a better election prediction, but it means that the reason for measuring public opinion, the entire justification for the endeavor, has been abandoned. Public-opinion polling isn’t enhancing political participation. Instead, it’s a form of disenfranchisement.
“There are all kinds of problems with public-opinion research, as done by surveys,” Lupia admits. “But a lot of the alternatives are worse. A lot of what we’d have would be self-serving stories about what’s good for people. ‘When given a clear choice between eggs and bananas, ninety-eight per cent of the people prefer one or the other.’ Prior to the polls, I can say that, and you have no check on me. But if there’s a poll you have a check.”
That’s a good point, too, except that there isn’t much of a check on political scientists who don’t reveal their methods because they’ve sold their algorithms to startups for millions of dollars. Whether or not they’re making money, people who predict elections want to be right, and they believe, as fiercely as Lupia does, that they are engaged in a public good. I asked Doug Rivers what role the measurement of public opinion plays in a democracy. He said, “The cynical answer is ‘Once the rockets are up, who cares where they come down.’ ” (He was quoting a Tom Lehrer song.) But Rivers isn’t cynical. He believes that polling “improves the quality of representation.” I asked him to give me an example. He said, “You couldn’t have had the change in gay marriage without the polling data.” Everyone cares where the rockets come down.
The day I visited Crowdpac, at the back of a one-story office building in Menlo Park, the staff was having a debate about what kind of takeout to order during the G.O.P. debate. “What is G.O.P. food? BBQ?” A piece of computer hardware labelled “Hillary’s Hard Drive: HEAVY USE: Now Perfectly Clean” rested on a coffee table. There were Bernie Sanders posters on the walls and cutouts of Rand Paul’s head popping out of a jar of pencils. Crowdpac is the brainchild of Steve Hilton, a former senior adviser to David Cameron, and Adam Bonica, a young Stanford political scientist. Their idea is to use data science to turn public-opinion polling upside down. “There had been an explosion in the use of data, all structured to advance campaigns,” Bonica says. “They’d take information from voters and manipulate it to the politicians’ advantage. But what if it could go the other way?” The company’s unofficial motto on its Web site used to be “Now you can get the data on them!”
Crowdpac is just getting off the ground, but it has provided an interactive Voter’s Guide for several federal, state, and citywide elections from Philadelphia to San Francisco and encouraged people to run for office. Liz Jaff, Crowdpac’s Democratic political director (she has a Republican counterpart), showed me a beta site she’d set up, whereby visitors who supported Planned Parenthood could look up all the unopposed G.O.P. candidates who have promised to defund Planned Parenthood and then pledge money to anyone who would run against them. The pledges would be converted to donations automatically, as soon as someone decided to run. Candidates could see how much money they would have, right out of the gate, and their opponents could see, too. “If you get a tweet saying you just got five hundred thousand dollars pledged against you, that sends a message,” Jaff said.
“We are trying to figure out what drives people to be interested in politics,” Hilton told me. “We are working on tools that help people get engaged with particular issues. If you care about fracking—for or against—what should you do? What candidate should you give money to? What people should you urge to run for office? We are uncovering the hidden political wiring of politics.”
I asked him if that wasn’t the role of the press.
“Maybe once,” he said.
Data science may well turn out to be as flawed as public-opinion polling. But a stage in the development of any new tool is to imagine that you’ve perfected it, in order to ponder its consequences. I asked Hilton to suppose that there existed a flawless tool for measuring public opinion, accurately and instantly, a tool available to voters and politicians alike. Imagine that you’re a member of Congress, I said, and you’re about to head into the House to vote on an act—let’s call it the Smeadwell-Nutley Act. As you do, you use an app called iThePublic to learn the opinions of your constituents. You oppose Smeadwell-Nutley; your constituents are seventy-nine per cent in favor of it. Your constituents will instantly know how you’ve voted, and many have set up an account with Crowdpac to make automatic campaign donations. If you vote against the proposed legislation, your constituents will stop giving money to your reëlection campaign. If, contrary to your convictions but in line with your iThePublic, you vote for Smeadwell-Nutley, would that be democracy?
A worried look crossed Hilton’s face. Lindsay Rogers has long since been forgotten. But the role of public-opinion measurement in a representative government is more troubling than ever.
Hilton shook his head. “You can’t solve every problem with more democracy,” he said.
To winnow the field of candidates who would hold the main stage in the second G.O.P. debate, in September, CNN had intended to use the average of national polls conducted over the summer. But after Carly Fiorina’s campaign complained that the method was unfair CNN changed its formula. The decision had very little to do with American democracy or social science. It had to do with the practice of American journalism. It would make better television if Fiorina was on the same stage as Trump, since he’d made comments about her appearance. (“Look at that face!” he said.)
“No one tells me what to say,” Trump had said in August. By September, on the defensive about Fiorina, he insisted—he knew—that he had the will of the people behind him. “If you look at the polls,” he said, “a lot of people like the way I talk.”
Donald Trump is a creature of the polls. He is his numbers. But he is only a sign of the times. Turning the press into pollsters has made American political culture Trumpian: frantic, volatile, shortsighted, sales-driven, and anti-democratic.
He kept his lead nearly till the end of October. “Do we love these polls?” he called out to a crowd in Iowa. “Somebody said, ‘You love polls.’ I said that’s only because I’ve been winning every single one of them. Right? Right? Every single poll.” Two days later, when he lost his lead in Iowa to Ben Carson, he’d grown doubtful: “I honestly think those polls are wrong.” By the week of the third G.O.P. debate, he’d fallen behind in a national CBS/NYT poll. “The thing with these polls, they’re all so different,” Trump said, mournfully. “It’s not very scientific.” ♦
For several months, Islamic State militants have been using instant messaging apps which encrypt or destroy conversations immediately. This has inhibit U.S.
intelligence and law enforcement agencies from identifying and monitoring suspected terrorists, even when a court order is granted, because messaging companies
and app developers say they are unable to unlock the coded conversations and/or do not have a record of the conversations. “We’re past going dark in certain
instances,” said Michael B. Steinbach, the FBI’s top counterterrorism official. “We are dark.”
For several months, Islamic State militants have been using instant messaging apps which encrypt or destroy conversations immediately. This has inhibit U.S.
intelligence and law enforcement agencies from identifying and monitoring suspected terrorists, even when a court order is granted, because messaging companies
and app developers say they are unable to unlock the coded conversations and/or do not have a record of the conversations.
“We’re past going dark in certain instances,” said Michael B. Steinbach, the FBI’s top counterterrorism official. “We are dark.”
FBI officials want Congress to expand their authority to monitor apps such as WhatsApp and Kik, as well as data-deleting apps such as Wickr and Surespot, used
by hundreds of millions of people, including terrorists and their supporters, because they guarantee security and anonymity.
About 200,000 people worldwide are exposed to “terrorist messaging” daily from ISIS supporters via direct messaging, online videos, or social media posts. ISIS
recruiters also monitor Twitter and Facebook to connect with individuals who share the group’s posts, often inviting them to private conversations over encrypted or
data-deleting apps.
FBI officials fear that law enforcement agencies are missing important clues about potential plots as terror-linked conversations go from social media to private
messaging apps. The FBI has arrested nearly forty people since last summer on the suspicion of seeking to support terrorist groups. A vast majority of those
people communicated their intentions through social media. Last Tuesday, an FBI agent and a Boston police officer shot and killed a 26-year old former security
guard in Roslindale, Massachusetts after he allegedly lunged at them with a knife. The FBI had been tracking his social media communications with ISIS for at
least several days.
ISIS and its supporters are now increasingly communicating via secure and encrypted messaging platforms. “These tactics are a sea change for spreading terror,
and they require from us a paradigm shift in our counter-terrorism, intelligence and our operations,” Representative Michael McCaul (R-Texas), chairman of
the House Homeland Security Committee, said last Wednesday at a congressional hearing.
The Los Angeles Times reports that FBI officials have not disclosed details of cases in which private messaging apps have been used by terrorists, but they have
appealed to tech and software companies to work with law enforcement to monitor suspected terrorist communications.
Apple chief executive Tim Cook in a 1 June speech at the annual awards dinner for the Electronic Privacy Information Center, defended his company’s decision to
encrypt the content of Facetime and iMessage communications. He lashed out at government officials who have asked Apple and other tech firms to create a
backdoor key to encrypted messages. “Let me be crystal clear,” Cook said. “Weakening encryption or taking it away harms good people that are using it for the
right reasons. And ultimately, I believe it has a chilling effect on our 1st Amendment rights and undermines our country’s founding principles.”
At last Wednesday’s congressional hearing, Steinbach said that the FBI seeks a legal way to access stored text messages and active communications in
suspected terrorism cases. “We’re talking about going before the court, whether the criminal court or the national security court, with evidence, a burden of proof,
probable cause, suggesting a crime has been committed or, in our case, that there’s a terrorist,” he said.
“We’re not looking at going through a backdoor or being nefarious,” he said.
“We are imploring Congress to help us seek legal remedies toward that as well as asking the companies to provide technological solutions to help that,”
Steinbach said.
Public demand for e-mail and text messaging services which guarantee security and anonymity has risen since Edward Snowden leaked details about the NSA’s
bulk data collection program. Still, federal officials want tech companies to know the risk associated with their services. “It is important for those who are providing
the services to understand what the threats are and to be responsible … in terms of taking action to prevent designated terrorist groups from using their services to
try to get people to commit terrorist acts here,” John Carlin, head of national security for the Justice Department, said in a recent interview.
While ISIS seems to have successfully mastered how to use social media to recruit new followers, the medium has its weaknesses. Air Force analysts at Hurlburt
Field, Florida recently helped destroy a command center in Syria after a militant revealed enough information online to disclose his position. “The (airmen are)
combing through social media and they see some moron standing at this command,” Gen. Herbert “Hawk” Carlisle, head of Air Combat Command at Langley Air
Force Base, Virginia, said in a speech on 1 June, according to Air Force Times. “And in some social media, open forum, bragging about command and control
capabilities for (ISIS). And these guys go, ‘Ah, we got an in.’”
“So they do some work. Long story short, about 22 hours later through that very building, three (‘smart’ bombs) take that entire building out. Through social media.
It was a post on social media. Bombs on target in 22 hours,” he said. “It was incredible work, and incredible airmen doing this sort of thing.”
ISIS, however, has been aware of the vulnerabilities of social media. Last fall, the group’s leaders issued an order forbidding fighters to photograph attacks and
locations without permission from the group’s general council. The Times notes that ISIS also distributed a guide to removing geo-location and metadata from cell
phone images.
In the wake of the Charlie Hebdo attack last
January, the French government advocated new
legislation to stop the use of social networks as
hate-speech vehicles by ISIL supporters, who
were also using those platforms to coordinate
their terrorist acts.
Harlem Desir, State Secretary for European
Affairs, proposed an international legal
framework that would make Facebook and
Twitter share responsibility when used to spread
messages promoting violence.
But the attacks which ravaged the French capital
yesterday showed how social media can also play
a much more positive role.
Facebook activated its Safety Check tool,
introduced in October 2014 to help people in
areas afected by a disaster let their Facebook
friends know they are safe. Twitter was also
helpful: residents used the hashtag
#porteouverte to offer shelter to people stranded
in the city.
Another important hashtag, #rechercheParis, is
being used to search for missing loved ones last
seen near attack sites.
#ParisAttacks and #FranceUnderAttack are
spreading information and updates about the
attacks, while #PrayForParis gathers messages of
solidarity and support for the victims and their
fellow citizens.
But there’s also a darker side to social media:
when a disaster strikes, it can easily become a
source of disinformation. As BBC journalist Dave
Lee notes, it’s difficult, in the midst of confusion,
to distinguish false rumors from news. When a
refugee camp in Calais was set on fire, for
example, someone tweeted it was done in
revenge, while it most likely was just due to an
electrical fire.
White House candidate Donald Trump was also a
“victim” of this witch-hunt: although he tweeted
a a message of condolence, people shared
instead, as if it were new, a tweet he made some
months ago where he made a correlation
between the Charlie Hebdo attacks and the fact
the the possession of a gun in France wasn’t so
widespread as in the U.S. Needless to says, he
was accused of speculating on the murders.
Even worse, according to some reports, ISIL (or
ISIS) supporters celebrated the attacks on
Twitter, under an hashtag in Arabic which,
translated to English, reads as “#ParisInFlames,”
or “#ParisBurns.” While this appears to be true
(Vice News gathered a couple of these infamous
tweets), it’s difficult to estimate the extent of this
“celebration.”
According to independent analyst Rita Katz, who
in her Insite Blog tracks ISIL propaganda on
social media, the latest attacks, “were part of a
purposefully timed campaign to create hatred
against France amongst jihadis.”
She also pointed to how #ParisInFlame was used
– among others – by supporters of the Caliphate.
However the #ParisInFlame hashtag seems to
have been used also by neutral, non-partisan
Twitter users, simply to describe what was happening in Paris, and doubts have been cast on
Katz’s methodology before, so caution is advised
before making any claim that could be used to
increase anger and sorrow even further.
If there’s one thing that the admittedly
brief history of social media has taught us so far,
it’s that these powerful tools are a double-edged
sword: they can be used to show support and
help coordinate rescue efforts, or they can also be
tools for disinformation and hate speech.
After the new attacks, it is possible that the
French government will call for greater and more
effective surveillance powers and the recent
project of harsher legislation for social
media might gain new strength.
It would be a legitimate and understandable
reaction: the risk, though, is to to get rid of the
good sides of social networks, along with the bad.
Recently, the online education firm Coursera announced a new arrangement with Google,
Instagram and other tech firms to launch what some are calling “microdegrees” – a set of
online courses plus a hands-on capstone project designed in conjunction with top universities
and leading high-tech firms. Coursera is one of America’s leading MOOC developers
(Massive Open Online Courses).
Together with other developments, such as rival MOOC developer Udacity’s “nanodegree”
program, the Coursera announcement could be an important step in a radical shakeup of
higher education. That shakeup holds the prospect of far less expensive and more
customized degrees that are more in tune with the recruiting needs of major employers.
Why does this announcement suggest such a shakeup is likely? Several reasons. Here are
just four:
MOOCs are moving from novel sideshow to serious competition. Similar to other new
ventures and technologies, MOOC developers have struggled with quality – such as high
drop-out rates from huge class enrolments – in addition to developing a viable business
model. But through partnerships with employers and sometimes with prestigious
universities (e.g. Udacity’s $7,000 master’s program with Georgia Tech), MOOCs and
other online education developers are on the verge of sustainable business models.
That’s a real threat to traditional universities.
The partnership between online education and employers is likely a game-changer.
MOOCs and other online education developers recognize that many college degrees are
disconnected from the needs of employers, reducing the value of those traditional
degrees. By forming partnerships and designing programs in conjunction with employers,
ventures with new business models are offering their students programs and degrees
that will make them more attractive job candidates. It’s not just MOOCs like Coursera.
New entrants like College for America, which now offers a $10,000 bachelor’s degree, are
also teaming up with major employers such as Anthem Blue Cross, Gulf Oil, and
McDonalds to offer customized degrees.
Accreditation as a restriction on competition is eroding. The cumbersome and
expensive accreditation process has served as an obstacle to new business models,
protecting existing colleges and universities. There have been moves to streamline or
reform the accreditation process, including experiments with competency based
certificates. But partnerships like Coursera’s include employers actually certifying groups
of courses as meeting industry’s standards for skills and knowledge – essentially an endrun
around traditional accreditation as a measure of quality.
Microdegrees are likely the pathway to customized degree programs. Specialized
microdegrees are certainly of interest to both undergraduates and graduates looking for
enhanced and marketable qualifications at an affordable price. But with the emergence of
employer-credentialed multiple-course programs, it is only a matter of time before
enterprising colleges or other entrepreneurs start assembling comprehensive degree
programs consisting of microdegrees supplemented by other experiences, such as a
semester abroad and time at a small liberal arts college. I describe this as the “general
contractor” model of college education.
There are still some university administrators who believe that innovations in online education
and new college business models are a passing fad, or that they can just add some new
technology features to their business model and continue more-or-less as usual. Coursera’s
announcement is just one more indication that they will soon be proved wrong.
This has been a great year (2014) for podcasts. A really great year. "Serial" blew everyone away with its 12-part investigation, PRX's podcast collective Radiotopia raised $620,000 in its kickstarter campaign, and articles in New York magazine, the New York Times and International Business Times hailed this as a golden age of podcasts.
----
“Did you listen to this week’s Serial?” That’s been the question on everyone’s lips the past three months. The podcast, which reexamined the 1999 murder case of a Baltimore teenager, become morning Gchat convo—and launched a thousand think pieces declaring 2014 “The Golden Age of Podcasts.”
While individual podcasts have previously broken through the cultural consciousness—like comedian Marc Maron’s WTF in 2009—the genre has generally been a niche interest since it hit iTunes in 2005. That year, there were only about 3,000 podcasts up and running. A decade later, that number has mushroomed to more than 285,000 podcasts, created in over 100 languages. The DIY radio of the Internet is now a bona fide medium, heard by an estimated 39 million Americans a month.
To celebrate the format’s true coming of age—it is indeed “golden”—our very own obsessive pod people are telling you what you must hear in the new year.
With her positive messages and dark themes, Louise O’Neill is leading a new wave of young adultfiction
Sarah Hughes
Sunday 21 June 2015 00.04 BST
The idea for her first book came to Louise O’Neill in a cafe in New York on a cold January
morning in 2011. Then 26, O’Neill was working at Elle magazine in Manhattan and had
recently started to relapse back into the anorexia she first suffered from at the age of 14.
“I was really very, very thin at this point,” she says. “The weather was really bad and I was
sitting in Starbucks reading a trashy magazine, In Style or something like that. It had all these
pictures of celebrities on their winter holidays in St Barts in bikinis and their different body
parts were picked out with red circles highlighting their muffin tops and their cellulite and I
looked over at the next table and there was a girl eating a muffin.
“I was sitting there nursing my green tea and I was fascinated because she made it look so
casual. I couldn’t understand – why wasn’t she having an existential crisis about eating it? At
that moment I had this vision of a teenage girl standing in a bikini in front of a class of other
girls while a nun-like figure drew circles on her body and the rest of the class banged their
desks and yelled ‘fat’, ‘fat’, ‘fat’. It was just incredibly vivid so I got out my notebook and
started writing. An hour and a half later I’d filled the book.”
The result of that moment of inspiration, Only Ever Yours, a dark examination of notions of
female beauty set in a future where girls are manufactured not born, became one of the most
critically acclaimed young adult novels of recent years drawing comparisons with Margaret
Atwood’s dystopian classic The Handmaid’s Tale and praised by everyone from Jeanette
Winterson to Marian Keyes.
It was shortlisted for both this year’s Waterstones children’s book prize and the Children’s
Books Ireland book of the year and won the inaugural Young Adult book prize while the Irish
Book Awards named O’Neill newcomer of the year. In the US it sold out on pre-order and was
reprinted before its publication in May. Small wonder then that her publisher Quercus,
convinced of the book’s crossover appeal, will bring out an adult edition on 2 July, an honour
previously bestowed on the bestselling likes of JK Rowling and Suzanne Collins, author of
The Hunger Games.
“I’m trying not to get too caught up in it all,” O’Neill says. “I’m really grateful that people
understand the work and the message I’m trying to put across because I felt passionately that
we needed to talk about the way in which we view women’s bodies. We spend our lives
looking at images of 6ft tall, size six Victoria’s Secret models and our self-esteem and selfworth
starts to dip.
“I’d say that of the women I know only three or four aren’t affected in some way by the idea
that they should look a certain way. Many women make a correlation between moral worth
and weight and I really wanted to explore that. I didn’t set out to write a young adult novel
when I wrote Only Ever Yours but I was in a way writing for myself at 16.”
That willingness to tackle dark and difficult themes – her second novel, the brilliant,
harrowing Asking For It, due out 3 September, is set in present day Ireland (O’Neill is from
the small town of Clonakilty in Co Cork) and focuses on a rape at a party – has placed O’Neill
at the forefront of a young adult publishing revolution. For it’s not just that young adult
novels are among the most popular genre in publishing (and read by teenagers and adults of
both sexes alike), it’s that increasingly they are tackling important issues with honesty,
humour and a steely precision that other supposedly more serious novels frequently lack.
Thus Becky Albertalli’s Simon vs the Homo Sapiens Agenda is a subtle, affecting look at a
young gay teenager’s first steps towards coming out, Lisa Williamson’s The Art of Being
Normal tells the moving story of a young transgender teen, Naomi Jackson’s The Star Side of
Bird Hill looks at notions of race and identity as two sisters move from Brooklyn to Barbados,
while Keris Stainton’s Reel Friends series depicts teenage female friendships that feel
modern and utterly true.
“There’s definitely a difference in how YA books are portraying female characters,” says
O’Neill. “They’re more aspirational in that they present more of a reflection of something a
teenage girl can look up to, saying this is what a healthy and positive relationship looks like.
This is a healthy and positive way to be a girl.”
Not that they’re shying away from dark themes. “Oh God, no,” says O’Neill. “I decided to
write Asking For It because I wanted to talk about the idea that rape isn’t just being pulled
into an alleyway by a stranger, that there are many different levels. All of my friends have
stories of sexual assault and sexual experiences that weren’t right. They’ll say this is what
happened when I was 17 and the terrible thing is I’m not surprised. I’m not surprised that
they were sexually assaulted, or raped, that their drinks were spiked or they were too drunk
to consent. We need to talk about the idea that sex isn’t something that men forcibly take
from women. We tell girls ‘don’t get raped’, when we should be teaching boys ‘don’t rape’.”
Her books are equally unflinching about life in the social media age. “Social media is a
double-edged sword,” says O’Neill, herself an enthusiastic user of Twitter. “There are
extremely positive elements to it, particularly the way in which it makes it easier for us to
connect and build our own communities. Even selfies can be positive – I think there’s
something brave and amazing about teenage girls posting pictures of themselves saying,
‘This is how I look and I am beautiful’ but it’s also true that it can exacerbate feelings of not
being good enough. There’s so much toxic competitiveness when you’re a teenage girl, so
much are my thighs smaller than hers? Am I prettier? Do boys like me more? Social media
adds to the pressure and then society tells young women that they must look sexy and act
sexy but that they can’t be sexual beings.”
Comments such as this help explain why O’Neill’s books are read as much by the anxious
mothers of teenage girls as by the girls themselves. “The key is to be honest,” she says when
asked what advice she would give those parents. “I would hope mothers who read my books
understand the pressures their daughters are under and why they are acting or behaving the
way they are. Try to encourage honest communication, be open and interested, try to
understand.”
And what would she tell the teenagers of either sex who devoured Only Ever Yours. She
laughs. “The most important thing is to care less about what other people think of you and
More features
Topics
Children and teenagers
Young people
Women
Body image
Social media
More…
focus more on yourself, your values and ethical system then live according to that,” she says.
“It sounds very ‘to thine own self be true’ but it’s the only way to live. When I wrote Only
Ever Yours it was at a time when I was so sick and tired of feeling shame around my body
and so weary of fighting the fact that women are seen as less in so many ways. I wanted to
articulate how that felt. For years we’ve been told that our stories aren’t as important, that
the concerns raised by Marian Keyes are lesser than those raised by Nick Hornby. I wanted to
tell teenage girls that their stories aren’t trivial. Their voices are worthy of being heard. I
wanted to say speak up, you don’t have to silence yourselves.”
FIVE OF THE BEST IN YOUNG ADULT FICTION
Shadowshaper by Daniel José Older
Acclaimed fantasy writer Older makes his young adult fiction debut with this wonderful tale
of Brooklyn teenager Sierra Santiago whose summer is interrupted by magic and ghosts.
Am I Normal Yet by Holly Bourne
An involving look at feminism, friendship and the secrets we hide even from those who know
us best.
More Happy Than Not by Adam Silvera
A gut-wrenching story telling of race and sexuality, which is set in the Bronx, in New York, in
the near future.
For Holly by Tanya Byrne
The latest from one of the genre’s rising stars, a suspense-filled family drama with a
gloriously angry teen at its heart.
Suicide Notesfrom Beautiful Girls by Lynn Weingarten
After her best friend kills herself June tries to uncover the truth in this dark thriller that’s
been described as Gone Girl meets 13 Reasons Why