opus-mt-fr-en

Performs bidirectional sequence-to-sequence translation from French to English using the Marian NMT framework, a specialized transformer-based encoder-decoder architecture optimized for translation tasks. The model uses byte-pair encoding (BPE) tokenization with a shared vocabulary across language pairs, enabling efficient handling of morphologically rich French input. Translation inference runs via HuggingFace Transformers pipeline abstraction, supporting batch processing and multiple backend frameworks (PyTorch, TensorFlow, JAX) without code changes.

Processes multiple French sentences simultaneously through vectorized transformer operations, automatically padding sequences to the longest input in the batch and applying causal attention masks to prevent cross-contamination. The Marian encoder processes all padded sequences in parallel, then the decoder generates translations token-by-token with cross-attention over the full encoded context. Batch size tuning directly trades memory consumption against inference throughput (e.g., batch_size=32 uses ~2GB VRAM but achieves 10x speedup vs batch_size=1).

The model is distributed in multiple serialization formats (PyTorch .bin, TensorFlow SavedModel, JAX-compatible weights, and safetensors) enabling deployment across heterogeneous infrastructure without retraining. The safetensors format provides memory-safe deserialization with built-in integrity checks, preventing arbitrary code execution during model loading. HuggingFace Transformers automatically selects the appropriate backend based on installed libraries, allowing the same model artifact to run on PyTorch-only servers, TensorFlow-only environments, or JAX-based research clusters.

Applies byte-pair encoding (BPE) tokenization with a shared vocabulary across the OPUS-MT language pair collection, mapping French text to subword tokens that balance vocabulary size (~32k tokens) against compression efficiency. The tokenizer handles French-specific morphology (accented characters, contractions like 'l'école') through learned BPE merges, avoiding character-level fragmentation. Vocabulary sharing across language pairs enables zero-shot transfer and reduces model size compared to language-specific tokenizers.

Exposes cross-attention weights from the Marian decoder, enabling visualization of which French input tokens the model attends to when generating each English output token. Attention weights are extracted as (batch_size, num_heads, target_length, source_length) tensors, allowing token-level alignment analysis and debugging of translation errors. This capability supports interpretability workflows where developers inspect attention patterns to understand model behavior or identify systematic translation failures.

The Marian architecture and weight distribution are compatible with post-training quantization (INT8, FP16) without significant accuracy loss, enabling deployment on edge devices with limited memory (e.g., mobile phones, embedded systems). The model's relatively small size (~300MB in FP32) becomes ~75MB in INT8 quantization, fitting within typical mobile app constraints. Quantization is applied after training via libraries like ONNX Runtime or TensorFlow Lite, without requiring model retraining.