The team explored the performance of various AI chatbots and LLMs in supporting the adoption of Rules as Code for SNAP and Medicaid policies using policy data from Georgia and Oklahoma.
The team developed an AI solution to assist benefit navigators with in-the-moment program information, finding that while LLMs are useful for summarizing and interpreting text, they are not ideal for implementing strict formulas like benefit calculations, but can accelerate the eligibility process by leveraging their strengths in general tasks.
A recap of the two-day conference focused on charting the course to excellence in digital benefits delivery hosted at Georgetown University and online.
MITRE’s Joe Ditre and Frank Ruscil demoed the code for the Comprehensive Careers and Supports for Households (C-CASH) at Rules as Code Demo Day. The MITRE team expanded the accessibility of the Policy Rules Database and the Cost-of-Living Database (the prior demo) by creating a web service API and a front-end Window’s application called C-CASH Analytic Tool (CAT). CAT provides a more scalable, flexible, and portable functionality which allows end-users to generate various households to run eligibility scenarios across different U.S. counties and states. They are currently working to create a national data hub and analytics tool, starting with utilizing U.S. Census data and populating the data warehouse by pushing large amounts of data through the PRD.
We kicked off Rules as Code Demo Day with Alex Soble of 18F and Mike Gintz of 10x presenting their Eligibility APIs Initiative that explores whether APIs and rules as code might improve the efficiency and effectiveness with which federal public benefits programs communicate their policy to states. They demonstrated their original prototype, and how the open source code has now been extended into several initiatives.
At Rules as Code Demo Day we heard from Song Hia of the NYC Mayor’s Office for Economic Opportunity and Ethan Lo of the NYC Office of Technology and Innovation who demoed the NYC Benefits Platform Screening API which provides machine-readable calculations and criteria for benefits screening that power the ACCESS NYC screening questionnaire. This makes it easier for NYC residents to discover multiple benefits they may be eligible for. The City is now extending the API to support the new MyCity platform, a one-stop shop for all services and benefits.
Building on our February 2022 report Benefit Eligibility Rules as Code: Reducing the Gap Between Policy and Service Delivery for the Safety Net, the Beeck Center’s Digital Benefits Network (DBN) recently held a convening to share progress and potential in digitizing benefits eligibility and to begin addressing how a national approach could be started.
The Policy2Code Prototyping Challenge explored utilizing generative AI technology to translate U.S. government policies for public benefits into plain language and code, culminating in a Demo Day where twelve teams showcased their projects for feedback and evaluation.
The team developed an application to simplify Medicaid and CHIP applications through LLM APIs while addressing limitations such as hallucinations and outdated information by implementing a selective input process for clean and current data.
The team introduced an AI assistant for benefits navigators to streamline the process and improve outcomes by quickly assessing client eligibility for benefits programs.
The team developed an application to simplify Medicaid and CHIP applications through LLM APIs while addressing limitations such as hallucinations and outdated information by implementing a selective input process for clean and current data.
