Keploy: AI Testing Assistant for Developers – Supercharge Unit, Integration, and API Testing in Python, JavaScript, TypeScript, Java, PHP, Go, and More

Generates unit tests for individual functions by analyzing function signatures, parameters, return types, and code paths through an AI model, then displays an inline code lens button above each function definition in the editor. The extension parses the current file's AST to identify function boundaries and sends function context to a backend AI service that generates test cases, which are then inserted into the project's test directory with appropriate framework bindings (JUnit for Java, Jest/Mocha for JavaScript, pytest for Python, etc.).

Generates unit tests for all functions in a selected file by clicking a play button next to the file in the Keploy sidebar or Project Directory. The extension scans the entire file's AST, identifies all top-level and nested functions, and submits them to the AI backend in a batch operation, generating a complete test suite for the file and organizing tests by function. This capability leverages the same AI model as per-function generation but applies it across multiple functions in a single operation.

Displays generated test cases in the editor for developer review before committing them to the codebase. Tests are presented with syntax highlighting, line numbers, and context (function being tested, test framework syntax), allowing developers to read, understand, and manually edit tests before accepting them. The extension likely provides accept/reject buttons or allows inline editing of generated tests before they are saved to disk.

Displays a Keploy sidebar panel in VS Code showing the project's file structure with play buttons next to each file, enabling one-click batch test generation for any file. The sidebar integrates with VS Code's file explorer, showing files in a tree view with action buttons, and allows developers to quickly generate tests for any file without navigating to the file in the editor. This provides a centralized entry point for test generation across the entire project.

Automatically runs each generated test case 5 times sequentially to detect and eliminate flaky tests (tests that pass/fail non-deterministically). The extension executes the test suite multiple times in the background, analyzes pass/fail patterns, and discards or flags tests that don't consistently pass, ensuring only reliable tests are retained. This mechanism runs after test generation and before tests are presented to the developer.

Measures code coverage for each generated test case and discards tests that do not improve overall code coverage metrics. The extension instruments the code, executes each test, collects coverage data (line coverage, branch coverage, or path coverage — specific metric unknown), and retains only tests that increase coverage. This filtering runs after flake detection and ensures the final test suite is both reliable and coverage-efficient.

Displays code coverage metrics and visual indicators (line highlighting, coverage percentages, uncovered line markers) directly in the VS Code editor as tests are generated and executed. The extension instruments the code, runs the test suite, collects coverage data, and renders coverage information inline — likely using VS Code's gutter decorations, line background colors, or status bar indicators to show which lines are covered, partially covered, or uncovered.

Automatically detects the project's test framework (JUnit/TestNG for Java, Jest/Mocha/Vitest for JavaScript/TypeScript, pytest for Python, PHPUnit for PHP, Go's native testing for Go) by scanning project configuration files (pom.xml, package.json, setup.py, composer.json, go.mod) and generates test code in the correct framework-specific syntax. The extension maintains framework-specific templates and code generation rules, ensuring generated tests follow the project's existing testing conventions without requiring developer configuration.

Executes generated tests directly within VS Code and displays pass/fail results inline in the editor or sidebar, without requiring developers to switch to a terminal or test runner. The extension runs the test framework's CLI (pytest, Jest, JUnit, etc.) in the background, captures output and exit codes, and renders results as inline decorations (checkmarks for passing tests, X marks for failing tests) or in a sidebar panel showing test names, status, and error messages.

Generates tests for code written in Python, JavaScript, TypeScript, Java, PHP, and Go by using language-specific code analysis and generation patterns. The extension maintains separate code parsers, AST analyzers, and test generation templates for each language, enabling it to understand language-specific idioms (e.g., Python decorators, JavaScript async/await, Java generics) and generate tests that follow language conventions. The AI backend is likely language-agnostic, but the extension's frontend handles language-specific parsing and formatting.

Automatically organizes generated test cases into appropriate test files and directories following project conventions (e.g., tests/ directory, test_*.py naming for Python, *.test.js for JavaScript). The extension detects the project's test directory structure, applies language-specific naming conventions, and places generated tests in the correct location without requiring developer intervention. Tests are organized by function or file, with clear naming that maps back to the source code.

Generates tests that account for project dependencies, imports, and external libraries by analyzing the project's dependency manifest (package.json, pom.xml, requirements.txt, composer.json, go.mod) and understanding which libraries are available. The extension can generate tests that use mocking libraries (Mockito for Java, Jest mocks for JavaScript, unittest.mock for Python) or integration tests that use real dependencies, depending on the project's configuration. This enables generated tests to be immediately runnable without manual dependency resolution.