Continuously opining, intermittently publishing.

Archive for the ‘Education’ Category

10
November

Barbri California

334 Comments » | Posted by oshane

I’ve been wanting to do a post-mortem on the bar review course I took for California this summer with Barbri.

Sufficiency of the Materials
Overall, the course was helpful. I took Barbri’s mobile course, which allowed me to watch videos and study from home. Because California is a large national market of bar applicants looking for assistance in preparation for the exam, most of the substantive lectures were very good. The multistate bar examination (MBE) preparatory materials (the MBE is the 200-question multiple choice test that 48 jurisdictions use on the Wednesday of bar exam week) were helpful, because they escalated in difficulty and idiosyncrasy over time. I found Richard Sakai’s pragmatic lectures about how to take the essays generally helpful and Peter Jan Honigsberg’s lectures about the California Performance Test also to be very encouraging and helpful.

That said, the price of the program is too high for the material that is provided. Barbri certainly provides a significant&#151almost overwhelming&#151amount of material to the applicant. To its credit, Barbri makes no assumptions about what the average test taker needs and provides the full gamut of preparatory material so that each student has all the material any applicant might need to study. While I rarely looked at the complete subject matter outlines (instead using the lecture notes or the mini-review), the full outlines allow people who are completely unfamiliar with a subject to study them and feel satisfied they won’t need to do research elsewhere to understand the subject. There were more than enough past essays with model answers to practice and more than enough past performance tests with their own model answers to analyze. The sets of MBE questions were comprehensive.

Value
The irony is that because California is a national market for bar review (i.e., many applicants from all over the country take the test twice a year), the costs Barbri has in producing the materials and paying for the lectures must be subject to economies of scale, particularly when the legal material doesn’t change much from year to year. On one hand, I wonder if the inherent value* of the material is much less than the $4000 price tag of the program. To some extent, the cost of materials plus reasonably moderate double-digit profit** cannot possibly equal $4000. Some of the extra margin is driven by demand for Barbri’s goodwill. That it has been in business for thirty years and that lawyers (or would-be lawyers) are more predisposed to risk avoidance means that law students are routinely more likely to go with the dominant service provider in the market (the apparent tautology that more consumers choose the dominant vendor notwithstanding).

Moreover&#151and I think it was Sakai or Honigsberg that implied as much in one of their lectures&#151California graders have come to expect that essays and performance tests have the formats that Barbri recommends applicants use, simply because (a) so many Barbri students establish a modal “average” for what a 60- or 65-mean scored essay should look like; and (b) many graders themselves used Barbri to prepare for the California Bar Exam when they took it. Thus, Barbri has established a quasi-virtuous cycle with the California bar exam graders and its own students. Students take Barbri because it can claim a higher-than-average pass rate for the California Bar Exam. Some of that incremental difference is likely driven by the fact that graders subconsciously expect essays on the whole to look like Barbri recommends, potentially leading to more satisfactory scores for Barbri students.

Thus, the profit margins that California Barbri students pay are attributable both to its historical presence (goodwill) in the market and a virtuous cycle.

I wonder&#151at least for self-motivated home studiers&#151whether it would be less costly and equally as effective to get hold of written California Barbri essay materials in the secondary market (thanks to the First Sale Doctrine***, eBay, and Amazon) and simply practice writing essays that look similar to Barbri essays. On the other hand, if one is simply just perusing the Barbri materials without paying for the service, it is arguably more worthwhile simply to look at the selected answers California releases with past exams for a more direct understanding of what graders are looking for.

Undoubtedly, part of the value Barbri provides is in the feedback loop it provides for its students. Barbri, because of its size and customer base, can scale MBE practice question scores relative to other Barbri students, which provides, assuming its MBE questions on average represent the MBE questions created by the National Conference of Bar Examiners, an effective sample size for low-error rate comparison between other California test takers and a good guess at what a student’s MBE score will look like.

The Other Part of the Feedback Loop:
Essay Grading

Barbri also grades its students’ essays. This is the most value-lacking part of the course. I’ve heard from Barbri students in other jurisdictions that the essay grading in those places is helpful and a fairly accurate representation of the grading that will be done by actual bar examiners.

Not so in California. Barbri graders routinely grade practice essays with an élan for doom. The scores students receive are typically very low, particularly at the beginning of the course, and sometimes at the end. No one really knows why but a consensus is that that Barbri is attempting to bootcamp its students into realizing that the California graders will not treat graciously a poorly written essay. On one hand, that could be commendable tough love. For me, it was nerve-racking and unhelpful. At first, when I received an excessively low grade from Barbri, I crusaded to shore my bar exam essay writing skills up. And then when more low scores were returned to me, I became discouraged. It wasn’t until I read about students literally copying model answers word for word, submitting them as experiments, and still receiving failing grades, that I realized that Barbri was intentionally deflating scores to impel its students to work harder.

At one point, I received a 45 on an essay. I had made some mistakes, but nothing seemingly major. When I compared my essay to the grading rubric, I realized the grading system was a farce. A Barbri 45 indicates that the essay had not identified one major issue. In fact, in my essay, I had identified all but one minor issue. The grading was self-referentially incoherent as compared to the standards.

I do not doubt that for some students, the Stick can be a very motivating incentive to try harder and do better as opposed to the Carrot. For me&#151as I am already a self-motivated, self-starting student&#151it was simply discouraging. All I wanted was honest feedback. If an essay truly deserved a 45, then I wanted to hear it. At one point, I wrote an essay that I thought was akin to a 75, and I think I received a 65. At that point, my disagreement with Barbri would have been debatable, if not pointless. 65 is a passing grade for an essay on the California Bar Exam, and if in real life the essay was actually a 75, then telling me I received a 65 might have been marginally helpful to keep me from complacency without harming my own developing self-heuristic for what way of writing would help me pass a real essay question.

But when Barbri’s eagerness to keep its students from prosaic complacency leads them to fail practice essays by a wide margin when the essay may have been borderline or even a fair pass, Barbri loses its effectiveness as a preparatory tool. This also doesn’t comport with Barbri’s goodnatured cheerleading and its continual reminders that we should prepare enough, but just enough, to pass. It was difficult for me to simply aim for a barely passing grade but, my own fastidiousness for excellence aside, the fact that Barbri was proclaiming we should do “just enough” as contrasted to its graders failing essays that were objectively just good enough to pass, reduced the utility, consistency, and clarity of the process overall.

Conclusion
We find out in eight days whether those of us who took the July 2011 California Bar Examination passed. I wanted to write my thoughts about the Barbri process before I found out, so that my opinion would not be colored by whether I passed the exam. That said, if I am honest with myself, good news next Friday will probably wash away the bad aftertaste in my mouth left by Barbri’s wonky practice essay grading system.

Overall, I found the program effective&#151maybe not perfectly tuned to the California Bar Exam like some of the smaller boutique tutoring programs in California may be&#151but sufficient. I still question whether the price tag is worth it. I certainly think $2000 would be an outstanding value. At $4000, students enter the realm of prices for private tutoring ($5000+), and I wonder if paying another $1000 would have made for a better, more productive, or more effective experience overall. Barbri should lower its prices, but it still seemed to provide a relatively good, though not perfect, value.


Footnotes
* Whatever this means. Value is always best calculated by what a willing buyer pays a willing seller. Thus, I don’t believe the $4000 price comprises just the value of the books and lectures, but also includes a host of intangibles. See supra.

** I do not begrudge high profits and do not really believe in the notion of “reasonable” profits as some sort of moral limiting factor on profit&#151that doesn’t mean I want (as a self-interested actor) to pay more than some arbitrarily low percentage of profit, even though I may still choose to do so anyway. Obviously there are comparative reverse inequalities of value at work. Such is the nature of free-market demand.

*** No doubt Barbri and zealous IP attorneys would argue the First Sale Doctrine does not apply to a set of “leased” books, but the designation of the books as under a lease is arguable, especially given the fact that there is an inherent liquidated damages provision in the Barbri agreement in case one does not return the books, stipulating he loses his book deposit. This, among other factors, makes the part of the transaction having to do with the written books look like a sale.

Full disclosure: I returned my California Barbri materials to Barbri per the face of my agreement with Barbri and received the deposit back.

3
June

The predicate article, here, speaks to a student-led initiative at Harvard Business School (HBS) to create an oath for its profession of management and garner voluntary buy-in for it.

The Columbia Code
According to the article, Columbia has employed an honor code of its own for several years now, and ironically, the piece quotes the Columbia code in full while merely linking to the Harvard student-driven oath, perhaps because the Columbia code is short and pithy. I like it:

As a lifelong member of the Columbia Business School community, I adhere to the principles of truth, integrity, and respect. I will not lie, cheat, steal, or tolerate those who do.

It is short and highly discretionary, and it expresses paragons of sound moral ideals.

Misery & Discord
Meanwhile, the Harvard student-led oath provides an exercise in patience to the reader as it drones on. In comparison to the Hippocratic oath or even the oaths at the bar that lawyers take, this one is somewhat vapid in its length (although the others on which it is presumably modeled in form are long, too).

One need for the use of oaths for professions such as medicine and law is that they, as industries, require misery and destruction to function. They are useful, as much as a device for bailing water or a life-raft is useful when one’s boat is sinking, but they do not generally add value so much as they, if the actors are good ones, preserve it. Of course, I do recognize that most doctors’ functions are like life rafts of some kind, whereas lawyers can serve as the life-raft or the sea-mine destroying the boat in the first place (such is the nature of the adversarial system).

Business Is Supposed to Create Value
Don’t get me wrong: many lawyers in their own misguided attempts to preserve (or even create) value, actually destroy it, because their own livelihoods and incentives usually rely on disagreements and conflict, which are necessarily value-destructive. The livelihoods of doctors are also fundamentally based in misery. Yet, business in general promotes increases in standards of living through innovation buoyed by an organic system that cyclically favors profitable endeavors but prunes the unprofitable. Zillions of actors independently negotiate within their ambits to maximize and optimize for this profitability, which is simply an accumulation of fungible resources iteratively expended to create new innovations and to ease pain and problems.

Business, as its core function, is supposed to create value. People pay to see greater value, to offset their own costs with greater benefits. When a business ceases to keep in mind that its purpose is to create value for its customers such that its revenue exceeds its costs, either its customers leave it and it fails or it fails due to cost constraints. Well, businesses succeed and fail in this manner as long as government does not falsely prop them up . . .

Oaths Provide a Check Against Amoral Incentives
So oaths, as they are, provide a check on the natural amoral incentives that would otherwise exist in industries whose substrate is misery so that the professionals taking the oaths do not allow those amoral incentives to be the primary impetus for their actions. Because the attorney’s livelihood exists only because of misery and discord, if the only constraint on his actions was his own creativity, then would he not seek to create legal misery in order to improve his revenue were it not for his own moral standards supported or circumscribed by the ideals inherent in his oath? Similarly, is not the evil doctor in stories always the one who supplants the common standards of the Hippocratic Oath in order to advance his own agenda in spite of the needs of his patients (experimental subjects)?

Is the student body at HBS admitting, thus, that the industry of professional managers rests upon a foundation of misery or that the incentives of its practitioners rests on activities that are, in some way, net value-destructive or both?

Oaths Provide a Check Against Negligent Actions That Have Great Consequences
The other scenario in which an industry of professionals may need an oath as a check against its amoral incentives is when the industry and its practitioners have the overwhelming power to materially alter the outcome of an enterprise or have so much control over the client’s position that the oath serves as a reminder to the practitioner to make judicious decisions assuming that he is acting in good faith anyway. That is to say, a doctor’s choices could kill the patient and the lawyer’s choices could ruin the legal case even if they are acting with the best of intentions, i.e., without malice. In short, they possess a lot of power.

Many professional managers, especially the ones who graduate from HBS and its ilk, often do possess a great deal of power. Top medium to large businesses hire them to take roles with high responsibility or high stakes or both. To that end, perhaps an oath is in order. Why, however, did the HBS student-initiative go beyond the pithy Columbia honor code, which seems sufficient to cover everything inherent in management?

A Deconstruction of Harvard’s Oath
The preamble, analogous to contractual recitals, begins:

As a manager, my purpose is to serve the greater good by bringing people and resources together to create value that no single individual can build alone. Therefore I will seek a course that enhances the value my enterprise can create for society over the long term. I recognize my decisions can have far-reaching consequences that affect the well-being of individuals inside and outside my enterprise, today and in the future. As I reconcile the interests of different constituencies, I will face difficult choices.

The irony begins in the first sentence. The nature of the free market, presuming the oath-taker is involved in the free market, is that pursuit of self-interest will serve the greater good in aggregate, assuming no theft. Lying and cheating tend to effect theft, so the aggregate good requires actors not lie or cheat either. Society, as an aggregation of consumers, will determine what is beneficial to it over the long term by buying what is offered by a business or not. Thus, to fulfill the first portion of the preamble, the oath-taker merely needs to engage in profitable business without lying, cheating or stealing. Beyond promising not to do any of those immoral acts, does a businessperson need to take a solemn oath to commit to engaging in profitable enterprise?

The last sentence is especially devoid of meaning. Life is filled with difficult choices. Perhaps if it served as the predicate clause to a statement of action, it would be useful, but to merely recognize that one will have difficult choices is similar to stating that the sun will rise and set.

The first promise states:

I will act with utmost integrity and pursue my work in an ethical manner. My personal behavior will be an example of integrity, consistent with the values I publicly espouse.

On its own, this statement, while somewhat nebulous, is good. It does not state the tenor of the oath-taker’s voluntary duty as incisively as the Columbia Honor Code, but it says enough.

The second promise states:

I will safeguard the interests of my shareholders, co-workers, customers, and the society in which we operate. I will endeavor to protect the interests of those who may not have power, but whose well-being is contingent on my decisions.

While this statement seems edifying, it is in toto unnecessary or nonsensical. Employees of a company, from the CEO down to the lowest worker, owe a fiduciary duty to the company and its owners. Safeguarding the interests of customers at large is vital to the success of a business, so taking an oath to do so seems to be stating, simply, that the oath-taker will attempt to run a profitable business. If the end result is that companies where HBS-graduates have influence turn out to behave more like American Express, Southwest Airlines, Google and the like, i.e., are customer-driven, then that is a net-positive. Still, it seems unnecessary.

Safeguarding the interests of co-workers is an overly broad promise, and as such, incoherent. Certainly, if the oath purports to constrain the oath-taker from cheating, lying to or stealing from coworkers, then it is meant well. On the other hand, the Columbia Honor Code would have been sufficient for this meaning. But, not all interests of all coworkers are actually beneficial or in the best interest of the company and shareholders. When the co-worker has illicit or immoral interests, safeguarding them is also immoral. Surely the oath does not purport to mandate the safeguarding of all interests of co-workers, which makes it overinclusive.

Safeguarding the interests of society is a meaningless construction. Society, with respect to a business, is the superset of all customers. Otherwise, it acts as a political strawman erected by others to praise or a company even when its actions are unhelpful to its customers or lambast the company even when its actions are helpful, profitable and legal. As stated, it is also an overinclusive label, and therefore one lacking in meaning. If the oath purports to constrain the manager to safeguard the property interests of his neighbors, then the law already provides both an obligation and multiple remedies to violation of such interests, and an oath not to steal would suffice.

The third promise states:

I will manage my enterprise in good faith, guarding against decisions and behavior that advance my own narrow ambitions but harm the enterprise and the people it serves. The pursuit of self-interest is the vital engine of a capitalist economy, but unbridled greed can be just as harmful. I will oppose corruption, unfair discrimination, and exploitation.

This is redundant. If one is serving himself but harming his enterprise and its customers, he is violating his fiduciary duty to the company.

What is unfair discrimination? What is exploitation? Neither are useful as labels and strike this author as political demagoguery.

The fourth promise states:

I will understand and uphold, both in letter and in spirit, the laws and contracts governing my own conduct and that of my enterprise. If I find laws that are unjust, antiquated, or unhelpful I will not brazenly break, ignore or avoid them; I will seek civil and acceptable means of reforming them.

Promising to do business according to the law seems like a mere reiteration of a thousand years of Anglo-Saxon culture and jurisprudence.

The fifth promise states:

I will take responsibility for my actions, and I will represent the performance and risks of my enterprise accurately and honestly. My aim will not be to distort the truth, but to transparently explain it and help people understand how decisions that affect them are made.

This is an excellent promise and one that could be a sufficient oath by itself. The actions the oath-takers avow to do here are greatly lacking particularly in big business. This is a laudable clause.

The sixth promise states:

I will develop both myself and other managers under my supervision so that the profession continues to grow and contribute to the well-being of society. I will consult colleagues and others who can help inform my judgment and will continually invest in staying abreast of the evolving knowledge in the field, always remaining open to innovation. I will mentor and look after the education of the next generation of leaders.

A cynical recasting of this clause would state, “I will be a good manager and strive not to be irrelevant and unmarketable. I will donate to the alumni fund.” The well-being of society is conceptually amorphous and better served by managers who will continue their fiduciary duties to their companies to increase profits by serving customers well. The rest of the clause strikes as self-serving or wrapped up in an implied duty of good faith to remain competent enough to actually perform ones duties as a manager well.

The seventh promise states:

I will strive to create sustainable economic, social, and environmental prosperity worldwide. Sustainable prosperity is created when the enterprise produces an output in the long run that is greater than the opportunity cost of all the inputs it consumes.

When I first read the short version of the oath, I only saw the first sentence, which to me lacked definition or was reliant on current vapid political notions of sustainability or both. The second sentence, however, is actually an excellent definition of sustainability with respect to, well, anything.

This second sentence is actually outstanding and should be the hallmark of more businesses in this country. Many large public companies are run with the intention to increase profitability within the an epsilon of the next financial quarter, or even worse, with the purpose of buoying the stock price, that false indicator of profitability and financial health.

Social prosperity and environmental prosperity as concepts extra-contextual to economic prosperity are impossible to measure, because measurement requires the fungible units the economic market provides.

In fact the entire statement is totally unmeasurable, except with respect to a business’ own income statement. The amazing quality of the free market is that it is decentralized and does not require a top-level view of costs to all parties. Not only is such impossible, even measuring the external costs caused by a company’s actions is problematic. This is precisely why the market’s actors, working for their own interests, paradoxically increase value for all actors in aggregate.

The final promise states:

I will be accountable to my peers and they will be accountable to me for living by this oath. I recognize that my stature and privileges as a professional stem from the respect and trust that the profession as a whole enjoys, and I accept my responsibility for embodying, protecting, and developing the standards of the management profession, so as to enhance that trust and respect.

From a high level, professional oaths are unworkable without widespread acceptance and peer review. This is a good attempt to encourage both. Of course, the fiduciary duty to one’s company may require decisions unpopular with ones peers.

A Reconstruction
If I were to reconstruct a more cogent and meaningful oath for professional managers, this is how I would do it while preserving most of Harvard’s words:

I will act with utmost integrity and pursue my work in an ethical manner. My personal behavior will be an example of integrity, consistent with the values I publicly espouse. [I adhere to the principles of truth, integrity, and respect. I will not lie, cheat, steal, or tolerate those who do.]

I will safeguard the interests of my [company, its] shareholders and [our] customers. [I will adhere to my fiduciary duty to them and act at all times in good faith.]

I will take responsibility for my actions, and I will represent the performance and risks of my enterprise accurately and honestly. My aim will not be to distort the truth, but to transparently explain it and help people understand how decisions that affect them are made.

I will strive [to effect] output[s] in the long run that [are] greater than the opportunity cost of all the inputs [they] [consume].

I will be accountable to my peers and they will be accountable to me for living by this oath.

Caveats
This deconstruction is, by no means, an indictment of HBS graduates or of Harvard Business School. More than a few good friends and talented colleagues (like Hannah, Craig, Sheryl, Laura, and others) have had the privilege of graduating from HBS, have enjoyed illustrious careers and have done good work. I consider them friends or talented colleagues or both, precisely because they already embody the characteristics that the MBA Oath was attempting to purport.

The oath simply has room for improvement.