The team explored using LLMs to interpret the Program Operations Manual System (POMS) into plain language logic models and flowcharts as educational resources for SSI and SSDI eligibility, benchmarking LLMs in RAG methods for reliability in answering queries and providing useful instructions to users.
The team developed an application to simplify Medicaid and CHIP applications through LLM APIs while addressing limitations such as hallucinations and outdated information by implementing a selective input process for clean and current data.
Building on our February 2022 report Benefit Eligibility Rules as Code: Reducing the Gap Between Policy and Service Delivery for the Safety Net, the Beeck Center’s Digital Benefits Network (DBN) hosted Rules as Code Demo Day on June 28, 2022 where there were eight demonstrations of projects and code followed by a collaborative problem solving session on how to continue advancing rules as code for the U.S. social safety net.
The team introduced "Policy Pulse," a tool to help policy analysts understand laws and regulations better by comparing current policies with their original goals to identify implementation issues.
The team developed an AI solution to assist benefit navigators with in-the-moment program information, finding that while LLMs are useful for summarizing and interpreting text, they are not ideal for implementing strict formulas like benefit calculations, but can accelerate the eligibility process by leveraging their strengths in general tasks.
The team developed an AI-powered explanation feature that effectively translates complex, multi-program policy calculations into clear and accessible explanations, enabling users to explore "what-if" scenarios and understand key factors influencing benefit amounts and eligibility thresholds.
At Rules as Code Demo Day Seth Hartig from the National Center for Children in Poverty (NCCP) and Bank Street College demoed the Policy Rules Database (PRD), a collaborative effort between the Federal Reserve Bank of Atlanta and the NCCP. The primary purpose of the PRD is to simplify the interpretation of all programs by creating a common structure and a common terminology. The repository allows for research on public assistance programs and tax policies, and helps users model benefits cliffs on career pathways. The PRD is supported by a technical manual with pseudocode that helps guide integration and usage in other platforms.
MITRE’s Joe Ditre and Frank Ruscil demoed the code for the Comprehensive Careers and Supports for Households (C-CASH) at Rules as Code Demo Day. The MITRE team expanded the accessibility of the Policy Rules Database and the Cost-of-Living Database (the prior demo) by creating a web service API and a front-end Window’s application called C-CASH Analytic Tool (CAT). CAT provides a more scalable, flexible, and portable functionality which allows end-users to generate various households to run eligibility scenarios across different U.S. counties and states. They are currently working to create a national data hub and analytics tool, starting with utilizing U.S. Census data and populating the data warehouse by pushing large amounts of data through the PRD.
The team introduced an AI assistant for benefits navigators to streamline the process and improve outcomes by quickly assessing client eligibility for benefits programs.
The team aimed to automate applying rules efficiently by creating computable policies, recognizing the need for AI tools to convert legacy policy content into automated business rules using Decision Model Notation (DMN) for effective processing and monitoring.
The team examined how AI, specifically LLMs, could streamline the case review process for SNAP applications to alleviate the burden on case workers while potentially improving accuracy.
The team developed an application to simplify Medicaid and CHIP applications through LLM APIs while addressing limitations such as hallucinations and outdated information by implementing a selective input process for clean and current data.
