The team developed an AI-powered explanation feature that effectively translates complex, multi-program policy calculations into clear and accessible explanations, enabling users to explore "what-if" scenarios and understand key factors influencing benefit amounts and eligibility thresholds.
Building on our February 2022 report Benefit Eligibility Rules as Code: Reducing the Gap Between Policy and Service Delivery for the Safety Net, the Beeck Center’s Digital Benefits Network (DBN) hosted Rules as Code Demo Day on June 28, 2022 where there were eight demonstrations of projects and code followed by a collaborative problem solving session on how to continue advancing rules as code for the U.S. social safety net.
The team explored using LLMs to interpret the Program Operations Manual System (POMS) into plain language logic models and flowcharts as educational resources for SSI and SSDI eligibility, benchmarking LLMs in RAG methods for reliability in answering queries and providing useful instructions to users.
The team conducted experiments to determine whether clients would be responsive to proactive support offered by a chatbot, and identify the ideal timing of the intervention.
The team aimed to automate applying rules efficiently by creating computable policies, recognizing the need for AI tools to convert legacy policy content into automated business rules using Decision Model Notation (DMN) for effective processing and monitoring.
The team introduced "Policy Pulse," a tool to help policy analysts understand laws and regulations better by comparing current policies with their original goals to identify implementation issues.
We wrapped up Rules as Code Demo Day with Max Ghenis and Nikhil Woodruff, the founders of PolicyEngine. The PolicyEngine web app computes the impact of tax and benefit policy in the US and the UK. With PolicyEngine, anyone can freely calculate their taxes and benefits under current law and customizable policy reforms, and also estimate the society-wide impacts of those reforms. Policymakers and think tanks from across the political spectrum can analyze actual policy. PolicyEngine is built atop the open source OpenFisca US and UK microsimulation models and they are building an open unified data set utilizing data from the Policy Rules Database, Current Population Survey, Survey of Consumer Finances, Consumer Expenditures, tax records, and IRS Public Use File.
The team examined how AI, specifically LLMs, could streamline the case review process for SNAP applications to alleviate the burden on case workers while potentially improving accuracy.
At Rules as Code Demo Day we heard from Song Hia of the NYC Mayor’s Office for Economic Opportunity and Ethan Lo of the NYC Office of Technology and Innovation who demoed the NYC Benefits Platform Screening API which provides machine-readable calculations and criteria for benefits screening that power the ACCESS NYC screening questionnaire. This makes it easier for NYC residents to discover multiple benefits they may be eligible for. The City is now extending the API to support the new MyCity platform, a one-stop shop for all services and benefits.
The first half of Rules as Code Demo Day was wrapped up with Thomas Guillet who has contributed to Open Fisca France and beta.gouv. He demoed the code for Mes Aides—or My Benefits—which is France’s social benefit simulator that leverages open source rule models for over 600 benefits while keeping the displayed complexity to its minimum.
At Rules as Code Demo Day Seth Hartig from the National Center for Children in Poverty (NCCP) and Bank Street College demoed the Policy Rules Database (PRD), a collaborative effort between the Federal Reserve Bank of Atlanta and the NCCP. The primary purpose of the PRD is to simplify the interpretation of all programs by creating a common structure and a common terminology. The repository allows for research on public assistance programs and tax policies, and helps users model benefits cliffs on career pathways. The PRD is supported by a technical manual with pseudocode that helps guide integration and usage in other platforms.