Voice 2 Code

A novel attempt to use LLMs to interact with VSCode using voice inputs. This project was built in 3 days in November 2024, before we had widespread Tool Calling support in models or MCP protocols. It also implements a custom XML parsing and processing strategy for structured output, before LLMs were widely able to output JSON reliably.

This project was showcased and recognized at the Rakuten Technology Conference 2024 conducted in Bangalore India.

Read more on how the project works on the GitHub Repository