Resource Digitizing Policy + Rules as Code Demos

Hoyas Lex Ad Codex at Policy2Code Demo Day at BenCon 2024

The team explored the performance of various AI chatbots and LLMs in supporting the adoption of Rules as Code for SNAP and Medicaid policies using policy data from Georgia and Oklahoma.

The Hoyas team investigated how different AI chatbots and other LLM perform on different tasks that support RaC adoption for SNAP and Medicaid policies. To do this, they experimented with the policies from several states. At the demo, they used Georgia’s SNAP policies and Oklahoma’s Medicaid policies to illustrate their findings. Their four experiments use well-known LLMs, including the web-browser versions of ChatGPT and Gemini, as well as the GPT4-o, Gemini, and Claude 3.5 Sonnet APIs.