A minor debate on X last week about lawyers' AI use led me to think I should write up a post on a topic I've been chewing on for a while: the problem of low visibility into lawyers’ responsible AI use. Without rehashing the debate, the starting

I have a post over at Lawfare today discussing continual learning—the goal many AI developers have to create models that can learn not just from their initial training, but from their day-to-day use. It turns out that this is a very challenging technical problem, but also one

Welcome to the latest in my series of informal tests on large language models in the context of legal questions. My first installment, back in March, compared many different models on legal questions of increasing difficulty. Of course, as luck would have it, OpenAI released its o3 model, a significant

When it comes to AI I normally focus on law and policy issues, but a few events in the last few weeks have made me want to depart from that beat a little for this post. So this post will have more of a “how to” / “what to try” flavor

Two months doesn’t seem like such a long time, but when it comes to AI model releases a lot can happen. Back in March, I wrote about some informal testing that I have been doing of large language models on legal questions for the last couple of years. Since

As soon as it started seeming possible that generative AI would reach levels of quality where it would become viable to use commercially, people started wondering about the legal industry. One particularly significant early prediction was a report by Goldman Sachs in March 2023 estimating that 44% of tasks in

One of my favorite anecdotes about AI and legal practice comes from a talk I was giving last spring to a group of lawyers. In the Q+A after the talk, one law firm partner raised his hand and told me about his week. Early in the week, his firm

As we get into the swing of a new year, we find ourselves in the midst of another flurry of legislative activity around AI. For years, a lot of conversation has focused on what kinds of laws we need to pass to regulate AI—do we need new laws, and

Like many people, when a new large language model comes out I often give it a whirl by running some questions by it and seeing how it does. I was recently offline for an extended period—a few months of parental leave—that happened to coincide with the release of

Welcome to "Test Case," my occasional blog. The popularity of blogs has ebbed and flowed over the years, but I have always felt like they occupy a useful niche. There are a lot of conversations worth having in formats that are longer than a tweet but shorter or