The team conducted experiments to determine whether clients would be responsive to proactive support offered by a chatbot, and identify the ideal timing of the intervention.
The Policy2Code Prototyping Challenge explored utilizing generative AI technology to translate U.S. government policies for public benefits into plain language and code, culminating in a Demo Day where twelve teams showcased their projects for feedback and evaluation.
The team examined how AI, specifically LLMs, could streamline the case review process for SNAP applications to alleviate the burden on case workers while potentially improving accuracy.
The team explored the performance of various AI chatbots and LLMs in supporting the adoption of Rules as Code for SNAP and Medicaid policies using policy data from Georgia and Oklahoma.
We wrapped up Rules as Code Demo Day with Max Ghenis and Nikhil Woodruff, the founders of PolicyEngine. The PolicyEngine web app computes the impact of tax and benefit policy in the US and the UK. With PolicyEngine, anyone can freely calculate their taxes and benefits under current law and customizable policy reforms, and also estimate the society-wide impacts of those reforms. Policymakers and think tanks from across the political spectrum can analyze actual policy. PolicyEngine is built atop the open source OpenFisca US and UK microsimulation models and they are building an open unified data set utilizing data from the Policy Rules Database, Current Population Survey, Survey of Consumer Finances, Consumer Expenditures, tax records, and IRS Public Use File.
We kicked off Rules as Code Demo Day with Alex Soble of 18F and Mike Gintz of 10x presenting their Eligibility APIs Initiative that explores whether APIs and rules as code might improve the efficiency and effectiveness with which federal public benefits programs communicate their policy to states. They demonstrated their original prototype, and how the open source code has now been extended into several initiatives.
The team developed an AI solution to assist benefit navigators with in-the-moment program information, finding that while LLMs are useful for summarizing and interpreting text, they are not ideal for implementing strict formulas like benefit calculations, but can accelerate the eligibility process by leveraging their strengths in general tasks.
The first half of Rules as Code Demo Day was wrapped up with Thomas Guillet who has contributed to Open Fisca France and beta.gouv. He demoed the code for Mes Aides—or My Benefits—which is France’s social benefit simulator that leverages open source rule models for over 600 benefits while keeping the displayed complexity to its minimum.
At Rules as Code Demo Day Seth Hartig from the National Center for Children in Poverty (NCCP) and Bank Street College demoed the Policy Rules Database (PRD), a collaborative effort between the Federal Reserve Bank of Atlanta and the NCCP. The primary purpose of the PRD is to simplify the interpretation of all programs by creating a common structure and a common terminology. The repository allows for research on public assistance programs and tax policies, and helps users model benefits cliffs on career pathways. The PRD is supported by a technical manual with pseudocode that helps guide integration and usage in other platforms.
MITRE’s Joe Ditre and Frank Ruscil demoed the code for the Comprehensive Careers and Supports for Households (C-CASH) at Rules as Code Demo Day. The MITRE team expanded the accessibility of the Policy Rules Database and the Cost-of-Living Database (the prior demo) by creating a web service API and a front-end Window’s application called C-CASH Analytic Tool (CAT). CAT provides a more scalable, flexible, and portable functionality which allows end-users to generate various households to run eligibility scenarios across different U.S. counties and states. They are currently working to create a national data hub and analytics tool, starting with utilizing U.S. Census data and populating the data warehouse by pushing large amounts of data through the PRD.