GPT Prompt Engineer

What is GPT Prompt Engineer

GPT Prompt Engineer is a tool available on GitHub that helps with prompt engineering for AI models. It uses GPT-4 and GPT-3.5-Turbo to generate and test different prompts based on provided use-cases and test cases. The system ranks the prompts using an ELO rating system, allowing users to determine the most effective prompts for their tasks. It also offers features like Weights & Biases logging and Portkey for prompt logging and tracing.

Key Features

• Prompt Generation: Utilizes GPT-4 and GPT-3.5-Turbo to generate a variety of prompts based on provided use-cases and test cases.
• Prompt Testing: Tests each generated prompt against test cases, comparing performance and ranking them using an ELO rating system.
• ELO Rating System: Each prompt starts with an ELO rating of 1200, changing based on performance in generating responses to test cases, making it easy to identify effective prompts.
• Classification Version: Specialized notebook for classification tasks, evaluating test case correctness and providing scores for each prompt.
• Weights & Biases Logging: Optional logging of configurations, prompts, test cases, and ELO ratings for each prompt to Weights & Biases.
• Portkey Integration: Optional tool for logging and tracing all prompt chains and their responses.