Tech News
← Home  ·  All topics

Cross Attention

1 GoKawiil brief on this topic

AI Model Mimics Jazz Pianists' Styles Using Cross-Attention Technique

Researchers fine-tuned a transformer-based AI called Aria on performances by twelve jazz pianists, incorporating a cross-attention layer to embed individual styles. The model's ability to generate stylistically accurate continuations was confirmed through classification tests, with conditioned outputs correctly attributed to the intended pianist 70% of the time. Listeners can compare different pianist styles from a single prompt, demonstrating the model's nuanced style replication.