In “Polygraphically Perverse,” former television show host Dick Cavett continues the story he began in his previous blog entry and explains how he stumped the polygraph operator that F. Lee Bailey brought on his show.
The Port-A-Poly Goes to Afghanistan: Fort Jackson Leader Reports Fielding of New Hand-Held Lie Detector
Some two weeks after MSNBC investigative reporter Bill Dedman broke the story of the Department of Defense’s new hand-held lie detector, formally dubbed the “Preliminary Credibility Assessment Screening System” (PCASS), Mike A. Glasch who writes for the weekly Reader, the official newspaper of Fort Jackson, South Carolina, picked up on the story in the 24 April 2008 issue (12.3 mb PDF). Ft. Jackson is home to the Defense Academy for Credibility Assessment, the school that trains all federal polygraphers and which developed the new “Port-A-Poly” (as one contributor to the AntiPolygraph.org message board has dubbed it):
New credibility device fielded
Mike A. Glasch
Leader StaffSoldiers in Iraq and Afghanistan are getting a new tool to help them weed out potential terrorists — the Preliminary Credibility Assessment Screening System (PCASS), a hand-held device that works much like a polygraph.
James Waller, an instructor at the Defense Academy for Credibility Assessment (DACA), left Sunday [20 April 2008] for Afghanistan to train troops on how to use it.
“Right now, our Soldiers are making life and death decisions: who to let or not let on base; who to release (or) who to keep, based on gut decisions,” Waller said. “This is just one tool to be used in the screening process.”
The idea of using junk science such as this polygraph-lite to make life and death decisions is an extremely foolish one. A “tool” that is known to be unreliable should not be relied on. Troops will be better off going with their gut and disregarding the flashings of the Traffic Light of Truth.
The subject has two wires connected to his fingertips or palm to measure changes in electrical conductivity of the skin. A third wire connected to a finger measures the subject’s intervals between heartbeats. Those wires are connected to a wrist cuff, which in turn is connected via USB to the PCASS.
The subject is asked a series of yes/no questions. The interviewer punches in the responses. PCASS then measures the subject’s physiological reactions and uses an algorithm – a computer program that makes the decisions – to determine if the subject is being truthful.
“The screen will display either red, green or yellow,” Waller explained. “Red means the subject was dishonest and lying to the security questions; green means they passed the test; yellow means the device did not get enough information to make a call so we need to rerun the test.”
So you re-run the PCASS when you get a yellow light. Kind of like shaking a Magic 8-Ball a second time when it says, “Try again later.”
Soldiers will use the devices when screening local nationals (it cannot be used on U.S. citizens) applying for jobs at bases in (Operation Iraqi Freedom) and (Operation Enduring Freedom), as well as when looking for suspected roadside bombers.
“Let’s say that we had an IED that was set off. A lot of times a patrol will cordon the area off, round up people from the area and question them,” Waller said. “Using the PCASS we can test them to see if they were involved in placing the bomb or actually detonating the bomb. It’s used for troops in the field to screen out the bad people from good people who are trying to do harm to U.S. forces or our coalition forces.”
The notion that this toy can be used “to screen out the bad people from the good people” is a dangerous delusion. Polygraph “testing,” of which the PCASS is a watered-down variant, has no scientific basis to begin with. Making matters worse, the “test” can be easily passed through the use of simple countermeasures that PCASS operators have no means of detecting. A federal polygraph examiner and past president of the American Polygraph Association has in all seriousness accused AntiPolygraph.org’s George Maschke of treason for publicly pointing out this fact.
According to Don Krapohl, special assistant to the director, DACA, three scientific studies were done on the device to determine its reliability. The Army conducted two of those studies; the third was contracted out to the Battelle Memorial Institute.
“Our accuracy rate, when you set the inconclusives aside, averaged 80 percent,” Krapohl said.
Both Krapohl and Waller agree that although PCASS is not 100 percent accurate, it is better than the current options available to Soldiers in the field.
There is no scientific ground for “setting inconclusives aside” for the purpose of determining the accuracy of a diagnostic test. DACA deliberately misled DoD about PCASS’s accuracy by leaving inconclusives out of the accuracy figures reported in a PowerPoint presentation (582 kb PDF). The studies were performed under highly unrealistic conditions that DACA knows will tend to make the procedure appear more accurate than it is in the real world. Paid volunteers pretended to commit a crime and were instructed to lie about it, and they would suffer no adverse consequences for failing to pass. Examinees were questioned in their native languages, rather than through an interpreter, as they will be in Afghanistan and Iraq. No testing of PCASS’s robustness against countermeasures was reported, nor was any test-retest reliability study conducted. Why not? Because Don Krapohl and others at DACA fear the results that realistic, unbiased testing would undoubtedly yield.
“It’s not a silver bullet,” Waller said. “It’s not perfect, but of all the technologies the National Academy of Sciences agrees that the polygraph and this type of technology is the most accurate. It’s better than what the troops do now, which is basically using gut intuition.”
Waller is misrepresenting the findings of the National Academy of Sciences (NAS) report, The Polygraph and Lie Detection. The report did not characterize polygraphy as “the most accurate” lie detection technology, as Mr. Waller misleadingly asserts. The report merely notes (at p. 173) that “[s]ome potential alternatives to the polygraph show promise, but none has yet been shown to outperform the polygraph.”
Nor does the NAS report support Waller’s claim that polygraph-type testing is better than using gut intuition, concluding instead (at p. 214) that “[t]here is essentially no evidence on the incremental validity of polygraph testing, that is, its ability to add predictive value to that which can be achieved by other methods.”
“Usually when we say it is less accurate than the polygraph[,] people pay attention to that and say, ‘Why are you using it if it’s less accurate?’” Krapohl said. “We like to point out that we don’t have enough polygraphers in the entire government to satisfy the requirements over in the theater.
“Gut instinct reliability is chance (50/50) or slightly better. That’s our benchmark. How do we improve about that and make this tool widely available? It (PCASS) gives us incremental validity over what we are doing right now.”
Don Krapohl is being less than honest. Once again, as the NAS report makes clear, there is no evidence that polygraph “testing” reliably provides incremental validity over that which can be achieved by other means, such as questioning a person, considering both their answers and demeanor, taking into account such relevant facts as are known, and reaching a considered judgment. The faulty studies conducted under the auspices of DACA provide no evidence that PCASS provides any incremental validity. Krapohl and DACA have willfully ignored the NAS report’s key conclusion that “[polygraph testing's] accuracy in distinguishing actual or potential security violators from innocent test takers is insufficient to justify reliance on its use in employee security screening in federal agencies.”
For related reading on the PCASS, see Preliminary Credibility Assessment Screening System: U.S. Deploys Hand-Held Lie Detector.
Dick Cavett on Lie Detectors
Writing on his New York Times blog, former television show host Dick Cavett recounts the story of the time F. Lee Bailey appeared on his show to demonstrate how the polygraph works. Only it didn’t. Cavett tantalizingly reveals that a follow-up blog entry will be titled, “The Secret of How I Beat the Infernal Machine.”
U.S. District Judge Jed Rakoff Derides Polygraphy as “Junk Science”
Kat Richardson reports for The Dartmouth on Judge Jed S. Rakoff’s remarks at his recent William H. Timber ‘37 Lecture, which was co-sponsored by the Dartmouth Legal Studies faculty and the Dartmouth Lawyers Association. Excerpt:
Science and the law are “uncomfortable” but inevitable “bedfellows,” Jed Rakoff, a U.S. District Judge for the Southern District of New York, said in a lecture Wednesday in the Rockefeller Center. The talk addressed the long-term love-hate relationship between the two fields.
“The law is very messy, and it is attracted to science in search of certainty,” Rakoff said.
The hate part of the relationship becomes relevant when pseudoscience, or “junk science” as Rakoff termed it, interferes with the court system. Rakoff gave many examples of these “junk sciences,” including the use of polygraphs and fingerprinting. These procedures are often inconclusive, he said in justifying his “junk” label.
“[The use of a polygraph] is not remotely scientific and, when it creeps into the courtroom, can create great mischief,” he said.
Rakoff gave an example of a case in which an Egyptian immigrant living in a hotel across from the World Trade Center towers had been wrongfully accused of being involved in acts of terrorism based on his appearance and almost convicted because of polygraph results. Luckily, the man was exonerated in light of new evidence.
Rakoff warned that law and science are now yoked together in an unprecedented way because society believes that science and certainty are synonymous. Judges must work to determine whether the science is credible, replicable and generally accepted by experts in the field, he stressed. If so, then evidence pertaining to the field is admissible in a trial. Judges are the best suited to bear this responsibility, according to Rakoff.
Regarding the case of Abdallah Higazy, the Egyptian referred to in the article (who was an exchange student, not an immigrant), and from whom an FBI polygraph examiner coerced a false confession, see the discussion thread, FBI Polygrapher Michael Templeton Named in Lawsuit (Higazy v. Templeton) on the AntiPolygraph.org message board.
TMZ: Dr. Phil’s Moment of Truth
TMZ.com lampoons Dr. Phil McGraw’s use of polygraphs and tawdry topics to boost ratings, comparing his daytime television talk show with the Fox network’s game show, The Moment of Truth. In point of fact, however, the Dr. Phil show’s shameless use of lie detectors as a ratings gimmick predates The Moment of Truth and has been the topic of much discussion on AntiPolygraph.org.
The Lie of Lie Detectors
Rob Shmerling of Harvard Health Publications comments on recent lie detection research using novel indices, as well on traditional polygraphy: Continue reading ‘The Lie of Lie Detectors’ »
Warning to U.S. Troops on Hand-Held Lie Detector
AntiPolygraph.org’s George Maschke addresses members of the U.S. armed forces who are being asked to rely on DoD’s new hand-held lie detector, the “Preliminary Credibility Assessment Screening System” (PCASS):
For discussion of the PCASS, see Preliminary Credibility Assessment Screening System: U.S. Deploys Hand-Held Lie Detector and How to Beat the Preliminary Credibility Assessment Screening System (PCASS) on the AntiPolygraph.org message board.
U.S. Military to Deploy Hand-Held Lie Detectors
Bill Dedman of MSNBC shines much-needed light on the U.S. military’s new “Preliminary Credibility Assessment Screening System” or PCASS. His on-line report, “New Anti-Terror Weapon: Hand-Held Lie Detector” is a must-read and includes documentation obtained under the Freedom of Information Act and a video segment with interviews and a demonstration conducted at the Defense Academy for Credibility Assessment.
For discussion of PCASS, see Preliminary Credibility Assessment Screening System: U.S. Deploys Hand-Held Lie Detector and How to Beat the Preliminary Credibility Assessment Screening System (PCASS) on the AntiPolygraph.org message board.
U.S. Foists Lie Detectors on Iraqi Government
Although the U.S. National Academy of Sciences roundly rejected polygraph screening as pseudoscience in a landmark 2002 report, the U.S. Government continues to swear by it. Now the U.S. military in Iraq is soliciting bids to train Iraqi government agencies in the black art of lie detection, as Sharon Weinberger of Wired’s “Danger Blog” reports in “Iraqi Government to Use Lie Detectors.”
It is worth bearing in mind that, as AntiPolygraph.org has documented, Al-Qaeda and Iraqi jihadist literature shows that they understand that the lie detector is a sham, and have some understanding of how to fool it.
State Department Orders Polygraph Tests in Passport Records Investigation
Washington Times reporters Bill Gertz and Jon Ward write that the State Department is resorting to the use of lie detectors in its investigation into improper access of the passport records of presidential candidates Barack Obama, Hillary Clinton, and John McCain. But reliance on a pseudoscientific test that is easily passed using simple countermeasures suggests that the investigation is perhaps not being taken as seriously as the State Department claims. Regarding the polygraph plan, Gertz and Ward write:
The probe by State’s inspector general will include polygraph tests for supervisors in the passport section to find out whether the three contract employees who accessed the records had a political motive or were part of a political operation to obtain personal data on Mr. Obama, Sen. John McCain or Sen. Hillary Rodham Clinton.
No one should place any reliance on polygraph results. A likely use of the polygraph in this instance would be to provide political CYA for the State Department: “Look, there was no political motivation on the part of these employees or their supervisors, and they passed polygraphs to prove it!”