The Policy2Code Prototyping Challenge explored utilizing generative AI technology to translate U.S. government policies for public benefits into plain language and code, culminating in a Demo Day where twelve teams showcased their projects for feedback and evaluation.
The team explored the performance of various AI chatbots and LLMs in supporting the adoption of Rules as Code for SNAP and Medicaid policies using policy data from Georgia and Oklahoma.
The team developed an AI-powered explanation feature that effectively translates complex, multi-program policy calculations into clear and accessible explanations, enabling users to explore "what-if" scenarios and understand key factors influencing benefit amounts and eligibility thresholds.
Building on our February 2022 report Benefit Eligibility Rules as Code: Reducing the Gap Between Policy and Service Delivery for the Safety Net, the Beeck Center’s Digital Benefits Network (DBN) hosted Rules as Code Demo Day on June 28, 2022 where there were eight demonstrations of projects and code followed by a collaborative problem solving session on how to continue advancing rules as code for the U.S. social safety net.
At Rules as Code Demo Day Seth Hartig from the National Center for Children in Poverty (NCCP) and Bank Street College demoed the Policy Rules Database (PRD), a collaborative effort between the Federal Reserve Bank of Atlanta and the NCCP. The primary purpose of the PRD is to simplify the interpretation of all programs by creating a common structure and a common terminology. The repository allows for research on public assistance programs and tax policies, and helps users model benefits cliffs on career pathways. The PRD is supported by a technical manual with pseudocode that helps guide integration and usage in other platforms.
The team aimed to automate applying rules efficiently by creating computable policies, recognizing the need for AI tools to convert legacy policy content into automated business rules using Decision Model Notation (DMN) for effective processing and monitoring.
We kicked off Rules as Code Demo Day with Alex Soble of 18F and Mike Gintz of 10x presenting their Eligibility APIs Initiative that explores whether APIs and rules as code might improve the efficiency and effectiveness with which federal public benefits programs communicate their policy to states. They demonstrated their original prototype, and how the open source code has now been extended into several initiatives.
Building on our February 2022 report Benefit Eligibility Rules as Code: Reducing the Gap Between Policy and Service Delivery for the Safety Net, the Beeck Center’s Digital Benefits Network (DBN) recently held a convening to share progress and potential in digitizing benefits eligibility and to begin addressing how a national approach could be started.
At Rules as Code Demo Day Executive Director Zareena Mayn and Chief Technology Officer Dize Hacioglu of mRelief demoed the code for their Supplemental Nutrition Assistance Program (SNAP) eligibility screener. mRelief is a women-led team that provides a web-based and text message-based SNAP eligibility screener to all 53 states and territories that participate in SNAP. They demonstrated how they have modularized their code to host federal program rules and state-specific rules.
The team developed an application to simplify Medicaid and CHIP applications through LLM APIs while addressing limitations such as hallucinations and outdated information by implementing a selective input process for clean and current data.