Incorporating AI Tools Into Your Legal Practice

Image Generated by ChatGPT

I published Advice for Incorporating AI Tools Into Your Legal Practice along with Celia Bigoness and Robert MacKenzie in the National Law Review. It reads,

We have been speaking with many lawyers and law students about using generative artificial intelligence (AI) tools in their legal practice. We are struck by the fact that many of them have not been experimenting much, if at all, with the tools that are available to them – although many acknowledge that their clients are increasingly integrating generative AI into their businesses. We have been integrating a lot of these tools into our own professional lives, and here are some tips to help lawyers and law students get comfortable with AI tools that can help them, in big ways and small, with their job.

Put it on Your Home Screen

Put your preferred AI app (ChatGPT, Claude, etc.) onto your phone’s home screen and be sure to allow it to access your phone’s microphone. You will be surprised by how often you get the urge to ask the app slightly complex questions that a basic web search would not answer. (Hat tip to one of our kids for this idea.)

Start with the Familiar

Trusting the output of an AI tool without having the ability to verify its accuracy is okay if you are choosing a movie to stream tonight. It is not okay if you are using it to provide legal advice to a client. To get comfortable with AI tools, start using it for tasks that you have experience executing and reviewing. One simple way to start: explain a familiar task to the AI tool and ask it for guidance on how you can use it to complete the task.

As you use AI tools in newer areas, you want to review the cited sources in the AI output to confirm that you agree with the AI model’s interpretation of them. Sometimes they are plain wrong, sometimes the AI model misinterprets the cited documents, and sometimes those documents are out-of-date.

When the stakes are greater than your personal entertainment, you need to do a lot of due diligence before you adopt an AI tool’s findings.

Use Multiple Tools

Different AI models are built on different training documents and have different algorithms that they apply to those documents. There is nothing more edifying than running the same queries through a few general AI models and a few specialized ones (like those geared to lawyers, in particular). You will see a range of answers, from non-answers to highly specialized and accurate ones. You will start to become a more sophisticated consumer of the different models, understanding each of their strengths and limitations.

Tell It Your Needs

Most AI tools will tailor their responses to your preferences. In some cases, we created a prompt to instruct the AI tool that responses should be of the type that a lawyer would like to receive—providing sources, explaining its analytical steps, and what it did and did not consider. The AI tool responded that it would be precise, answer “above a lay level,” and “be candid about uncertainty.” This has improved its answers and had the side effect of reducing sycophantic language (“That is a very good question!”).

Use it for Your Pain Points

We all have some routine tasks that we find irritating. They are usually the ones we procrastinate on. For some, it is preparing slide decks. For others, it is drafting certain kinds of emails (unpaid bills, anyone?). Just getting a first draft from the AI tool often helps you to finish the work up. But for some tasks, like preparing presentation slide decks, you can save hours and hours of your time.

We have experimented with both general AI tools and those that specialize in slide deck preparation. They have pros and cons, but are generally very helpful. In all these cases, the AI tool’s time savings are in large part due to the fact that the AI tool is optimizing a task that you are capable of doing yourself. You are able to quickly verify and edit the output.

However, if you were asking the tool to analyze a topic with which you are unfamiliar, or perform a task that you’ve never done before—if you’re learning from scratch—you will still need to go through the painstaking process of checking sources and confirming output.

Play in Vaults

One game-changing use of AI tools is to upload documents to a secure location in the cloud (sometimes referred to as a “vault”) and hone the tool’s focus on only those documents. A transactional lawyer can upload hundreds of documents and quickly identify commonly appearing terms for comparison or inconsistencies among them. A litigator can upload thousands of pages of litigation documents and create a draft chronology of events. Again, the output cannot be taken at face value due to the functional limitations of these tools, but it can provide an extraordinary first draft that can then be verified and edited to the form you prefer. This can be a game-changing use of AI for lawyers, as long as you have verified the vault’s security in advance.

Use it as a Second Set of Eyes

This is a great and scalable tip for those who are skeptical of AI tools. After you have completed a written task, ask an AI tool to critique for clarity, coherence, and accuracy. Even an experienced attorney will get at least a couple of suggestions that will ring true. And of course, you can reject all of the suggestions that you disagree with. This is a great way to see if an AI tool can provide you with real value with very little investment of your time.

Along the same lines, for more advanced experimentation, you can use the AI tool to issue spot and offer counterarguments to your work to complement your own analysis. Again, this is very low stakes because you can reject anything you find wrong-headed or irrelevant. Of course, you need to be careful about sharing privileged information (see vault security above).

Preserve Confidentiality

We have spent more time than many of you would like looking at the Terms of Use of the AI tools we have used. Except for certain tools that are developed for legal work in particular, we believe that the attorney-client privilege can be compromised when using many AI tools because of how the tools use your input information.

We have had students and clients who wanted to use AI transcription tools to compile meeting notes. We have advised them that confidential information can be compromised by such tools and that we do not use them in our practice, at least at this time.

If you begin to use a tool with client-identifying information, be sure to confirm that you are complying with your professional responsibilities to preserve client confidences.

Don’t get Lazy!

We all read the headlines about lawyers who use AI to draft legal documents and do not check to confirm that the work product is correct. Those lawyers rightfully face professional discipline and reputational consequences. We can all say that we would never do that, but a new term has arisen to describe an unthinking reliance on AI: “cognitive offloading.” This offloading occurs when we reduce our own deep research and thinking because of an unhealthy reliance on AI tools.

Every time we complete a substantive task with AI, we need to ask if we have thought through the task as fully as we would have if we did it without the tool. If the answer is no, we need to dig into it again. Cognitive offloading is a particular concern for law students and younger generations of lawyers, who have grown up with technology and tend to be more comfortable using AI tools – and therefore more susceptible to this unthinking reliance.

Conclusion

From our discussions with lawyers in private practice, it is clear that AI tools are being used in the ways we have mentioned above. No doubt, more specialized tools are in development. It’s clear that AI will transform the practice of law in the coming years. Those who are new to AI can use these pointers to begin exploring how AI works. We think they can amplify their effectiveness to the benefit of their clients and themselves, so long as the risks that AI tools pose are thoughtfully addressed.

 

Rethinking FHA Insurance

The Congressional Budget Office issued a report on Options to Manage FHA’s Exposure to Risk from Guaranteeing Single-Family Mortgages. FHA insurance stands out from other forms of mortgage insurance because it guarantees all of a lender’s loss, rather than just a portion of it. It is certainly a useful exercise to determine whether the FHA could reduce its exposure to those potential credit losses while also making home loans available to people who would otherwise have difficulty accessing them. This report evaluates the options available to the FHA:

The Federal Housing Administration (FHA) insures the mortgages of people who might otherwise have trouble getting a loan, particularly first-time homebuyers and low-income borrowers seeking to purchase or refinance a home. During and just after the 2007–2009 recession, the share of mortgages insured by FHA grew rapidly as private lenders became more reluctant to provide home loans without an FHA guarantee of repayment. FHA’s expanded role in the mortgage insurance market ensured that borrowers could continue to have access to credit. However, like most other mortgage insurers, FHA experienced a spike in delinquencies and defaults by borrowers.

Recently, mortgage borrowers with good credit scores, large down payments, or low ratios of debt to income have started to see more options in the private market. The Congressional Budget Office estimates that the share of FHA-insured mortgages going to such borrowers is likely to keep shrinking as credit standards in the private market continue to ease. That change would leave FHA with a riskier pool of borrowers, creating risk-management challenges similar to the ones that contributed to the agency’s high levels of insurance claims and losses during the recession.

This report analyzes policy options to reduce FHA’s exposure to risk from its program to guarantee single-family mortgages, including creating a larger role for private lenders and restricting the availability of FHA’s guarantees. The options are designed to let FHA continue to fulfill its primary mission of ensuring access to credit for first-time homebuyers and low-income borrowers.

*     *     *

What Policy Options Did CBO Analyze?

Many changes have been proposed to reduce the cost of risk to the federal government from FHA’s single-family mortgage guarantees. CBO analyzed illustrative versions of seven policy options, which generally represent the range of approaches that policymakers and others have proposed:

■ Guaranteeing some rather than all of the lender’s losses on a defaulted mortgage;

■ Increasing FHA’s use of risk-based pricing to tailor up-front fees to the riskiness of specific borrowers;

■ Adding a residual-income test to the requirements for an FHA-insured mortgage to better measure borrowers’ ability to repay the loan (as the Department of Veterans Affairs does in its mortgage guarantee program);

■ Reducing the limit on the size of a mortgage that FHA can guarantee;

■ Restricting eligibility for FHA-insured mortgages only to first-time homebuyers and low- to moderate-income borrowers;

■ Requiring some borrowers to receive mortgage counseling to help them better understand their financial obligations; and

■ Providing a grant to help borrowers with their down payment, in exchange for which FHA would receive part of the increase in their home’s value when it was sold.

Although some of those approaches would require action by lawmakers, several of the options could be implemented by FHA without legislation. In addition, certain options could be combined to change the nature of FHA’s risk exposure or the composition of its guarantees. CBO did not examine the results of combining options.

What Effects Would the Policy Options Have?

Making one or more of those policy changes would affect FHA’s financial position, its role in the broader mortgage market, and the federal budget. All of the options would improve the agency’s financial position by reducing its exposure to the risk of losses on the mortgages it insures (see Table 1). The main reason for that reduction would be a decrease in the amount of mortgages guaranteed by FHA. CBO projects that under current law, FHA would insure $220 billion in new single-family mortgages in 2018. The options would lower that amount by anywhere from $15 billion to $77 billion (see Figure 1). Some options would also reduce FHA’s risk exposure by decreasing insurance losses as a percentage of the value of the guaranteed mortgages. (1-2)

Reiss on Housing Finance Reform

Inside MBS and ABS, the trade journal, quoted me in DeMarco Cites ‘Structural Improvements’ in Housing Six Years After GSE Conservatorship, More Needed (behind a paywall). It reads,

Six years after the government takeover of Fannie Mae and Freddie Mac, the former regulator of the government-sponsored enterprises noted that the housing finance system has made “significant progress.” But even as critical structural changes are underway, comprehensive improvement is still several years out.

In a policy paper issued last week, Edward DeMarco–new senior fellow-in-residence for the Milken Institute’s Center for Financial Markets–said that house prices, as measured by the Federal Housing Finance Agency, have recovered more than 50 percent since their decline in 2007.

“While the damage from the housing crisis has been substantial, we are finally seeing a sustained market recovery,” said the former FHFA chief. “The crisis showed that numerous structural improvements were needed in housing–and such improvements have been underway for several years.”

Poor data, misuse of specialty mortgage products, lagging technologies, weak servicing standards and an inadequate securitization infrastructure became evident during the crisis.

“New data standards have emerged…with more on the way,” wrote DeMarco. “These standards should improve risk management while lowering origination costs and barriers to entry.” Development of the new securitization structure, begun more than two years ago, “should be a cornerstone for the future secondary mortgage market,” he added.

DeMarco said the major housing finance reform bills in the House and Senate share key similarities: “winding down Fannie Mae and Freddie Mac, building a common securitization infrastructure and drawing private capital back into the marketplace while reducing taxpayer involvement.”

DeMarco added, “We should build on these similarities, making them the cornerstone features of final legislation.” Prolonging the GSEs’ conservatorship, he warned, “will continue to distort the market and place taxpayers at risk.”

David Reiss, research director of the Center for Urban Business Entrepreneurship at the Brooklyn Law School, lauded the common securitization project. But Reiss worried the former FHFA head is too optimistic about the state of Fannie and Freddie.

“The GSEs have been in a state of limbo for far too long,” said Reiss. “All sorts of operational risks may be cropping up in the entities as employees sit around or walk out the door waiting for Congress to act.”

Shiller on Primitive Housing Finance

Robert Shiller has posted Why Is Housing Finance Still Stuck in Such a Primitive Stage? The abstract for this brief discussion paper reads:

The institutions for financing owner-occupied housing have not progressed as they should, and the financial innovation that has followed the financial crisis of 2007-9 has not been focused on improving the risk management of individual homeowners. This paper lists a number of barriers to housing finance innovation, and in light of these barriers, the problems of some major innovations of the past and future: self-amortizing mortgages, price-level adjusted mortgages (PLAMs), shared appreciation mortgages (SAMs), housing partnerships, and continuous workout mortgages (CWMs). (1)

The paper is more of an outline than a fleshed out argument, but it has some interesting points (and not just because the author recently won a Nobel Memorial Prize in Economics).  They include

  • Shared appreciation mortgages (SAMs), which offered some risk management of home price appreciation, were offered by the Bank of Scotland and Bear Stearns in the 1990s, but acquired a damaged reputation with the boom in home prices. U.K. homeowners who took such mortgages, and lost out on the speculative gains, were so angered that they filed a class-action lawsuit against the issuers. The suit was dropped, but the reputation loss was permanent. (5)

  • There has been some questioning of the assumption that insuring homeowners against a decline in home value is a good thing. Sinai and Soulelis (2014) have written that the existing  mortgage institutions may be close to optimal given that people want to live in their house forever, or move to a similar house whose price is correlated with the present house, and so are perfectly hedged. But their paper cannot be exactly right, given the sense of distress that homeowners are experiencing who are underwater. They are more certainly not right about all homeowners, many of whom actually plan to sell their home when they retire. (5-6)

  • The difficulties in making improvements in mortgage institutions have to do with the complexity of the risk management problem, coupled with mistrust of institutional players. The Consumer Financial Protection Bureau, created by the Dodd-Frank Act and having authority over mortgages, among other things, seems oriented towards addressing complaints from the public, and has focused its attention so far on such things as unfair collection practices, bias against minorities, and excessive complexity of financial products being used to confuse customers. These are laudable concerns, but complaints that economists might register about the fundamental success of mortgage products to serve risk management well have not yet taken center stage. (6)

  • New Development economics, Karlan and Appel (2011), Bannerjee and Duflo (2012) has shown how carefully controlled experiments can reveal solid steps to take regarding new financial institutions for poverty reduction. The same methods could be used to improve mortgage institutions, as well as rental, leasing, partnership and cooperative institutions, in advanced countries. (7)

These are just brief thoughts. It will be interesting to see how Shiller develops them further.

Reiss on Risk Management

Law360.com interviewed me in Banks Caught In Middle Of Regulators’ Fair-Lending Pursuits (behind a paywall).  The article reads in part,

Federal and state regulators are increasingly enlisting banks in their pursuit of fair-lending and other violations at payday and auto lenders and other financial services providers with which they do business, a tactic that has also increased banks’ risk of penalties for conduct by third parties.

In late October, the Office of the Comptroller of the Currency was the latest to put out new guidance for banks’ responsibility to monitor the activities of third-party vendors that perform operations on behalf of the bank. Other federal and state regulators have been calling on banks with growing frequency and force in recent years in order to ensure their vendors and clients comply with fair lending and other laws.

*     *     *

The increased use of pressure on banks to indirectly go after firms that may not be subject to federal or state laws or regulations comes after banks outsourced a great deal of their mortgage-lending operations and other services during the financial crisis, according to David Reiss, a professor at Brooklyn Law School.

While many of those vendors met high standards, others, particularly in the subprime loan context, did not. And banks didn’t monitor those failings, Reiss said.

“The crazy thing about that is you’d think banks would do this on their own,” Reiss said. “Why do they need their regulators to say, ‘Check on these things’?”