Project Grading

The stronger models can provide feedback on complex projects. For example, the project component of the NYU HW design class is using the LLM grader as part of an AI-based workflow where students are encouraged to iterate with an AI tool to develop plans. The plans are graded with the LLM grader.

Instead of uploading your plan, you may be simply request that you provide a URL to your GitHub project repository. The LLM grader provides OpenAI a web_search tool to inspect your GitHub and provide feedback.