Predictive Coding: Will E-Discovery Swallow The Judicial System?
In an earlier article, we discussed the significance of Magistrate Judge Andrew J. Peck’s (SDNY) opinion in Da Silva Moore v. Publicis Groupe (2/24/12), a highly publicized decision that approved of the use of computer-assisted review in place of “eyes on” document review..png)
Eric Seggebruch, the Regional Manager for eDiscovery at Recommind, Inc., testified before Judge Peck as an expert witness during a Da Silva Moore discovery hearing. Seggebruch has authored a helpful article titled “Electronic Discovery Utilizing Predictive Coding,” that provides both technical and practical insights concerning predictive coding and its likely future in the legal marketplace.
At its heart, the ESI debate revolves around the discussion of the concept of proportionality. By way of example, Da Silva Moore is an employment discrimination case with a universe of some three million records subject to review for document production purposes. Proportionality asks the question whether the costs involved in identifying potentially relevant documents are justified by what is at issue in the underlying litigation.
Nearly one year after Judge Peck’s decision in Da Silva Moore, the attorneys in that case reportedly continue to submit extensive (and presumably costly) briefs on ESI discovery issues. It is for this reason that the title of this article asks whether e-discovery will swallow the judiciary. Leaving aside the staggering costs to parties in litigation, the judicial resources necessary to address these issues may not be up to the task considering the time and intensity with which these battles are fought.
In evaluating the efficacy of predictive coding, Seggebruch tells us that there are two critical terms of art – “recall” and “precision.” “Precision” asks how many documents one has to look at to find a relevant document. By way of example, if you review one hundred documents and find fifty relevant documents, you have achieved 50% precision. “Recall” may be the more important element of the two. If a search of one hundred documents brings back twenty-five relevant documents but twenty-five relevant documents are missed, then “recall” is only 50%. The rate of “recall” in any document production, whether predictive coding or “key word” searches are used, is critical to the integrity of the process.
With increased acceptance of predictive coding over time, it is likely that the “key word” paradigm, with which most lawyers and judges are familiar, will most likely change. According to Seggebruch, scientific studies have shown that “key word” document analyses are less efficacious than predictive coding. However, adversary counsel cannot complain about the level of “recall” obtained from the “key word” analysis performed if they had significant involvement in selecting the “key words” used in the search.
As an indication of how quickly the technology in this field is moving, in some cases, lawyers are now demanding ESI discovery “do overs.” These lawyers argue that when their adversary performed their initial ESI production early in the case, they were admittedly adhering to the then prevailing best technology. However, since that initial production, new ESI techniques, such as predictive coding, have become available to provide potentially better results. To date, courts that have considered the “do over” petitions have either rejected them out of hand or required the requesting party to assume the costs.
In an .png)
On July 16-17, 2012,
Connecticut state courts have not provided a rule to address electronic discovery that would give guidance to litigants in a manner similar to the federal rules. In a significant decision, issued on November 18, 2011, the Hon. Barbara Brazzel-Massaro, who sits in
For those of us who work on document-intensive litigations, take note of Magistrate Judge Andrew J. Peck's (SDNY.) opinion released on February 24, 2012 in
New York practitioners should stay abreast of important new rules and proposed rules governing E-discovery in both the state and federal courts in New York. As reported by
Duane Morris reported today concerning a decision in Race Tires America, Inc. v. Hoosier Racing Tire Corp., 2011 U.S. Dist. LEXIS 48847 (W.D. Pa. May 6, 2011). There, the U.S. District Court for the Western District of Pennsylvania held that the prevailing defendants at trial may recover a whopping $367,000 in e-discovery costs because such costs are the modern-day equivalent of duplication costs. Although the court took care to limit its ruling to the "unique" facts associated with this case, should litigants consider more narrowly tailoring their discovery requests and seeking early agreement on the scope of electronic productions? Following an affirmance of an award of summary judgment to defendants by the Third Circuit, the defendants sought to recover their costs—the vast majority of which were related to e-discovery. The plaintiff objected, contending that the costs were not taxable pursuant to 28 U.S.C. § 1920(4), which permits recovery of "[f]ees for exemplification and the costs of making copies of any materials where the copies are necessarily obtained for use in the case." The issue before the district court was the applicability of § 1920(4) to electronically stored information, an issue which has not yet been addressed by the Third Circuit. In its ruling, the district court first focused on the words "exemplification" and "copying." While recognizing that these terms "originated in and were developed in the world of paper," it viewed the steps a vendor takes to produce electronic data as the "electronic equivalents of exemplification and copying." Defendants were able to demonstrate that plaintiff aggressively pursued e-discovery under the case management plan, and the court found that the requirements and expertise necessary to retrieve and prepare documents for production were an indispensable part of the discovery process. Although the district court limited the holding to the facts presented by the case, it is likely that the expanded view of 1920(4) will be debated in other district courts around the United States in the months to come. Although many courts have attempted to allocate the costs of e-discovery fairly before a party undertakes this obligation, this cases suggests that courts may seek to revisit the allocation of e-discovery costs following entry of judgment. According to the decision, it is up to the party seeking to recover these costs to demonstrate that the costs at issue were incurred for the sole purpose of complying with an adversary's demands rather than, for example, improving the appearance of documents for trial presentation purposes.
In In toxic tort cases where plaintiffs have questionable liability claims, serving burdensome e-discovery demands on defendants often threatens to change the focus of the case from the merits of the claim to a spoliation of evidence sideshow that focuses on the efforts of the defendant to preserve and produce electronically stored information ("ESI"). To avoid traps for the unwary (potentially both corporate defendants and the law firms that represent them), this blog will occasionally provide e-discovery guidance and reference information. The
Are defendants in New York product liability and toxic tort litigation better off in federal court than in state court? Federal court discovery rules certainly are more liberal than state court discovery rules. There, plaintiff’s experts are subject to deposition and, if appropriate, Daubert challenges. In contrast, state court provides only minimal expert disclosure. However, state court rules concerning the production of electronically stored information (“ESI”) may be more favorable to corporate defendants litigating in state court. In state court, the general rule is that the requesting party pays for the defendant’s ESI retrieval. In federal court, the court will apply “proportionality” concepts, and balance the importance of the discovery with the burden on the producing party. Thus, the result of the burden shifting analysis is somewhat more complex and subject to more variables. As reported in this space on November 4, 2009,
The Manual For State Trial Courts Regarding Electronic Discovery Cost-Allocation, authored by the Joint E-Discovery Subcommittee of the 
If you litigate in federal courts and have not yet reviewed the
On September 19, 2008, President Bush signed S. 2450 into law and new