Weighted Prompt Case Prioritization And Categorization

Prompt optimization library with systematic variation testing.

Unique: Implements case-level and category-level weighting that affects how cases contribute to aggregate Suite performance metrics, enabling risk-aware optimization where critical cases are weighted more heavily. Integrates categorization directly into the PromptCase model so cases can be grouped and reported on separately without post-hoc filtering.

vs others: More nuanced than unweighted testing because it allows prioritization of critical cases and separate reporting by category, whereas simple test frameworks treat all cases equally and provide only aggregate results.