Joint-Embedding Predictive Architectures

Last updated: July 8, 2023
Tags: Machine Learning

Introduction

In this post, I’ll review Meta AI’s new, self-supervised learning architecture [1], centered around the idea of multi-modal embeddings that has been popularized by Yann LeCun, and perform a from-scratch reimplementation in NumPy.

Footnote test ¹

Motivation

The authors draw attention to implicit biases in data augmentation.

References

[1] Assran, Mahmoud, Quentin Duval, Ishan Misra, Piotr Bojanowski, Pascal Vincent, Michael Rabbat, Yann LeCun, and Nicolas Ballas. 2023. “Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture.” https://arxiv.org/abs/2301.08243.

Here’s an example footnote ↩︎