Code To Code Retrieval For Clone Detection And Similarity

via “code-to-code retrieval with structural similarity matching”

Multilingual code evaluation across 17 languages.

Unique: Provides explicit code-to-code retrieval evaluation with support for cross-language matching, treating code similarity as a distinct task from NL-code retrieval. Uses the same retrieval corpus but with code-based queries instead of natural language.

vs others: More comprehensive than traditional clone detection benchmarks (BigCloneBench) because it includes cross-language matching and covers 17 languages, though smaller corpus than real-world code repositories.

via “code understanding and semantic embedding”

High-performance embedding models by Jina.

Unique: Unified embedding model handles code across multiple languages with semantic understanding of programming constructs, enabling cross-language code similarity detection without language-specific models

vs others: Semantic code embeddings enable intent-based search (vs. keyword-based grep/regex) and detect clones with different variable names or formatting that traditional tools miss

via “content-based deduplication at file and repository levels”

67 TB permissively licensed code dataset across 600+ languages.

Unique: Two-stage deduplication combining exact hash matching with fuzzy similarity matching (likely MinHash or Jaccard) to catch both identical and near-identical code — more thorough than single-stage approaches but computationally expensive

vs others: More aggressive deduplication than CodeSearchNet (which uses simple hash matching) because it catches near-duplicates, but less semantic than clone detection tools (which understand code structure) because it's content-based

via “near-deduplication and exact deduplication with semantic similarity detection”

783 GB curated code dataset from 86 languages with PII redaction.

Unique: Two-stage deduplication (exact + near) with MinHash-based similarity detection tuned for code semantics, rather than generic text deduplication — preserves code-specific patterns like function signatures while removing boilerplate

vs others: More aggressive deduplication than CodeSearchNet (which uses only exact matching) and more code-aware than generic text dedup, reducing training data size by ~30-40% while maintaining diversity

via “code-snippet-search-and-retrieval-from-codebase”

Experimental features for GitHub Copilot

Unique: Uses semantic code understanding to match patterns and implementations rather than text-based regex search, enabling developers to find functionally similar code even if variable names or syntax differ

vs others: More powerful than VS Code's built-in text search because it understands code semantics and can match patterns across different syntactic representations, whereas text search requires exact or regex-based matching

via “embedding-based-code-similarity-matching”

OpenCode plugin that gives coding agents persistent memory using local vector database

Unique: Applies embedding-based similarity matching specifically to code, capturing semantic equivalence beyond syntax and enabling agents to find related solutions even when code structure differs significantly

vs others: More semantically aware than AST-based matching for finding conceptually similar code, but less precise than syntactic analysis for detecting exact duplicates

via “code-to-code retrieval for clone detection and similarity”

Home of CodeT5: Open Code LLMs for Code Understanding and Generation

Unique: Uses learned code embeddings to detect functional code clones beyond syntactic similarity, capturing semantic equivalence even with different variable names or control flow structures

vs others: More accurate than token-based clone detection (e.g., CCFinder) for semantic clones because embeddings capture code meaning; faster than AST-based approaches because embeddings enable approximate nearest-neighbor search

via “code clone detection dataset with multilingual support”

Dataset by NTU-NLP-sg. 6,65,024 downloads.

Unique: Combines cross-language code pairs with expert-validated semantic equivalence labels, enabling training of language-agnostic clone detectors through token-classification and text-retrieval formulations — most prior clone detection datasets focus on single-language or syntactic similarity

vs others: Provides multilingual clone pairs with expert validation, whereas BigCloneBench focuses on Java-only clones and POJ-104 uses only syntactic matching without semantic validation