📚 PracticeMediumML ConceptKnowledge Ready

What is the attention mechanism in transformers?

ML Concept: 5-7 minutes to answer

nlptransformersdeep-learningmust-know
Updated Dec 20, 2025

Question

Question

What is the attention mechanism in transformers?

This is a critical concept for modern NLP and increasingly for other domains.

Expected time to answer: 5-7 minutes


Your Solution

python
Auto-saves every 30s

Try solving the problem first before viewing the solution


0:00time spent