Publications

Asterisk indicates equal contribution.

2024

  1. CPAL
    Unsupervised Learning of Structured Representations via Closed-Loop Transcription
    Shengbang Tong*, Xili Dai*, Yubei Chen, Mingyang Li, Zengyi, Li, Brent Yi, Yann, LeCun, and Yi Ma
    Conference on Parsimony and Learning (CPAL - Oral) 2024
    arXiv
  2. arXiv
    Unsupervised Feature Learning with Emergent Data-Driven Prototypicality
    Yunhui, Guo, Xudong Wang, Yubei Chen, and Stella X Yu
    In Submitted to Conference on Computer Vision and Pattern Recognition (CVPR) 2024
    arXiv

2023

  1. WACV
    Compact and Optimal Deep Learning with Recurrent Parameter Generators
    Jiayun, Wang*, Yubei Chen*, Stella X, Yu, Brian, Cheung, and Yann LeCun
    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2023
    arXiv
  2. ICLR
    Simple Emergent Action Representations from Multi-Task Policy Training
    Pu Hua, Yubei Chen*, and Huazhe Xu*
    International Conference on Learning Representations (ICLR) 2023
    arXiv Website
  3. TMLR
    Bag of Self-Supervised Image Patch Embedding Behind the Success of Self-Supervised Learning
    Yubei Chen*, Adrien, Bardes*, Zengyi, Li, and Yann LeCun
    Transaction on Machine Learning Research (TMLR) 2023
    arXiv
  4. ICLR - Oral
    On the Duality Between Contrastive and Non-Contrastive Self-Supervised Learning
    Quentin, Garrido, Yubei Chen, Adrien, Bardes, Laurent Najman, and Yann LeCun
    International Conference on Learning Representations (ICLR - Oral) 2023
    arXiv
  5. ICLR - Spotlight
    Minimalistic Unsupervised Representation Learning with the Sparse Manifold Transform
    Yubei Chen, Zeyu Yun, Yi, Ma, Bruno, Olshausen, and Yann LeCun
    International Conference on Learning Representations (ICLR - Spotlight) 2023
    arXiv
  6. arXiv
    URLOST: Unsupervised Representation Learning without Stationarity or Topology
    Zeyu Yun, Juexiao Zhang, Bruno, Olshausen, Yann, LeCun, and Yubei Chen
    2023
    arXiv

2022

  1. CVPR
    Clipped Hyperbolic Classifiers Are Super-Hyperbolic Classifiers
    Yunhui, Guo, Xudong Wang, Yubei Chen, and Stella X Yu
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022
    arXiv
  2. PMLR
    Disentangling Images with Lie Group Transformations and Sparse Coding
    Ho Yin, Chau, Frank Qiu, Yubei Chen, and Bruno Olshausen
    Proceeding of Machine Learning Research (PMLR) Volume on Symmetry and Geometry in Neural Representations (NeurReps@NeurIPS) 2022
    arXiv Code
  3. JMLR Submission
    Neural Manifold Clustering and Embedding
    Zengyi, Li, Yubei Chen, Yann, LeCun, and Friedrich T Sommer
    Submitted to Journal of Machine Learning Research, (JMLR) 2022
    arXiv Code
  4. arXiv
    Joint Embedding Self-Supervised Learning in the Kernel Regime
    Bobak T, Kiani, Randall, Balestriero, Yubei Chen, Seth Lloyd, and Yann LeCun
    arXiv preprint 2022
    arXiv
  5. ECCV
    Decoupled Contrastive Learning
    Chun-Hsiao, Yeh, Cheng-Yao Hong, Yen-Chi Hsu, Tyng-Luh Liu, Yubei Chen, and Yann LeCun
    European Conference on Computer Vision (ECCV) 2022
    arXiv
  6. DIRA@ECCV
    3D Shape Reconstruction from Free-Hand Sketches
    Jiayun Wang, Jierui Lin, Qian Yu, Runtao Liu, Yubei Chen, and Stella X. Yu
    The 2nd Workshop on Drawings and abstract Imagery: Representation and Analysis (DIRA), European Conference on Computer Vision (DIRA@ECCV) (Full-paper Spotlights) 2022
    arXiv Code
  7. MLST
    RG-Flow: a Hierarchical and Explainable Flow Model Based on Renormalization Group and Sparse Prior
    Hong-Ye, Hu, Dian Wu, Yi-Zhuang, You, Bruno, Olshausen, and Yubei Chen
    Machine Learning: Science and Technology (MLST) 2022
    HTML Code

2021

  1. Entropy
    A Neural Network MCMC Sampler That Maximizes Proposal Entropy
    Zengyi, Li, Yubei Chen, and Friedrich T. Sommer
    Entropy 2021
    HTML PDF Code
  2. DeeLIO@NAACL
    Transformer Visualization via Dictionary Learning: Contextualized Embedding as a Linear Superposition of Transformer Factors
    Zeyu Yun*, Yubei Chen*, Bruno, Olshausen, and Yann LeCun
    In Proceedings of Deep Learning Inside Out (DeeLIO@NAACL) 2021
    arXiv Code Website

2020

  1. CVPR
    Orthogonal Convolutional Neural Networks
    Jiayun Wang, Yubei Chen, Rudrasis Chakraborty, and Stella X Yu
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020
    arXiv Code

2019

  1. NeurIPS
    Superposition of Many Models into One
    Brian, Cheung, Alexander Terekhov, Yubei Chen, Pulkit, Agrawal, and Bruno A. Olshausen
    In Advances in Neural Information Processing Systems (NeurIPS) 2019
    arXiv Code
  2. Ph.D. Thesis
    The Sparse Manifold Transform and Unsupervised Learning for Signal Representation
    Yubei Chen
    University of California, Berkeley 2019
    Website
  3. Annual Meeting of SFN
    A Geometric Theory for Complex Cells
    Yubei Chen, Dylan M., Paiton, Bruno, Olshausen, and Friedrich T Sommer
    Annual Meeting of Society for Neuroscience (SFN) 2019
    PDF
  4. Entropy
    Learning Energy-Based Models in High-Dimensional Spaces with Multi-Scale Denoising Score Matching
    Zengyi, Li, Yubei Chen, and Friedrich T Sommer
    Entropy 2019
    arXiv Code
  5. arXiv
    Word Embedding Visualization via Dictionary Learning
    Juexiao Zhang*, Yubei Chen*, Brian, Cheung, and Bruno A Olshausen
    arXiv preprint 2019
    arXiv

2018

  1. NeurIPS
    The Sparse Manifold Transform
    Yubei Chen, Dylan, Paiton, and Bruno Olshausen
    Advances in Neural Information Processing Systems (NeurIPS) 2018
    arXiv PDF

2015

  1. RCIM
    Nonparametric Statistical Learning Control of Robot Manipulators for Trajectory or Contour Tracking
    Cong, Wang, Yu Zhao, Yubei Chen, and Masayoshi Tomizuka
    Robotics and Computer-Integrated Manufacturing (RCIM) 2015
    HTML

2013

  1. TIS
    Exploiting the Task-Pipelined Parallelism of Stream Programs on Many-Core GPUs
    Shuai, Mu, Dongdong Li, Yubei Chen, Yangdong, Deng, and Zhihua Wang
    IEICE Transactions on Information and Systems (TIS) 2013
    HTML
  2. VLSI
    Orchestrating Cache Management and Memory Scheduling for GPGPU Applications
    Shuai, Mu, Yangdong, Deng, Yubei Chen, Huaiming Li, Jianming Pan, Wenjun Zhang, and Zhihua Wang
    IEEE Transactions on Very Large Scale Integration (VLSI) 2013
    HTML

2012

  1. JCST
    Providing Source Code Level Portability Between CPU and GPU with MapCG
    Chuntao Hong, Dehao Chen, Yubei Chen, Wenguang, Chen, Weimin Zheng, and Haibo Lin
    Journal of Computer Science and Technology (JCST) 2012
    HTML

2011

  1. DAC
    Hermes: an Integrated CPU/GPU Microarchitecture for IP Routing
    Yuhao, Zhu, Yangdong, Deng, and Yubei Chen
    ACM/EDAC/IEEE Design Automation Conference (DAC) 2011
    HTML