In late 2016, the State Bar of California began a comprehensive evaluation of the California Bar Exam. The evaluation was prompted by several factors, including a multi-year decline in pass rates. This trend raised the question of whether the current pass line, or cut score, of 1440 is appropriate.
The current pass line was established over three decades ago. Critics point out that California’s pass line is higher than every other state in the country except for Delaware. Others contend that factors other than the cut score influence pass rates.
The California Supreme Court, which has ultimate authority over the Bar Exam and cut score, directed the agency to ensure that these studies:
The first three studies were completed in 2017. Each study was led by an outside consultant with nationally recognized expertise in the subject. In addition, the State Bar hired additional subject matter experts to serve as external reviewers of the studies’ methods and findings. A working group comprised of a single representative from the California Supreme Court, and two representatives each from State Bar Board of Trustees and the Committee of Bar Examiners, oversaw the work.
The 2017 studies included:
After completing the standard-setting study, the State Bar invited public comment, surveyed practicing attorney and applicants, and conducted public hearings. In September 2017, the State Bar issued a report to the California Supreme Court, which has ultimate authority over the California Bar Exam cut score.
The State Bar Board of Trustees offered three options for the Supreme Court’s consideration:
The report also outlined key issues related to the Court's policy decision – public protection, access to justice and diversity.
In October 2017, the Supreme Court issued its response, maintaining the current cut score for the time being, as the State Bar continued its research.
The fourth study, completed in 2018, examined changes in the characteristics of students taking the California Bar Exam to provide a better understanding of the declining trend of the bar passage rates. The study found that changes over time in the characteristics of exam takers accounted for between 20 and 50 percent of the decline in bar exam performance during the study period. The study was unable to account for a substantial amount of the decline in pass rates, concluding that other unexamined factors have contributed to the decade-long decrease in bar exam performance.
Dr. Roger Bolus led the study. An advisory group of law school deans participated throughout the project. The study examined detailed data on over 7,000 students (from 11 ABA law schools participating in the study) who took the California Bar Exam in July 2013, 2016, and 2017.
Individual data included information on students’ undergraduate grade point average (GPA), undergraduate major, LSAT score, final law school GPA, course work in law school, and basic demographic information. The study examined these characteristics in relation to bar exam performance—both pass/fail outcomes and scores. The study found that:
In December 2018, the State Bar began the first California-specific study of the knowledge and skills needed by entry-level attorneys. The study will collect detailed, empirical data about how attorneys use their knowledge and skills to perform routine tasks in their legal practices. Key components of the study will include focus groups and surveys of California attorneys. Castle Worldwide is conducting the study. A working group, with members selected by the California Supreme Court from state and national stakeholder groups, oversees the study.
The final report, scheduled for completion by December 2019, will set the foundation for revisiting the California Bar Exam pass line and content, as well as exam format and other aspects of the test.
For questions contact: Ron Pi, Principal Program Analyst, Office of Research & Institutional Accountability, 415-538-2013, ron.pi@calbar.ca.gov
Additional Information
Fact Sheet: California Attorney Practice Analysis