| Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation | Aug 27, 2021 | Inductive BiasPlaying the Game of 2048 | CodeCode Available | 2 |
| Fast and Flexible Human Pose Estimation with HyperPose | Aug 26, 2021 | Pose Estimation | CodeCode Available | 2 |
| Efficient and Systematic Partitioning of Large and Deep Neural Networks for Parallelization | Aug 25, 2021 | | CodeCode Available | 2 |
| Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learning | Aug 24, 2021 | CPUGPU | CodeCode Available | 2 |
| DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Cameras | Aug 24, 2021 | | CodeCode Available | 2 |
| Freeing Hybrid Distributed AI Training Configuration | Aug 20, 2021 | | CodeCode Available | 2 |
| Neural Operator: Learning Maps Between Function Spaces | Aug 19, 2021 | Operator learning | CodeCode Available | 2 |
| Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformers | Aug 16, 2021 | DecoderMedical Image Segmentation | CodeCode Available | 2 |
| FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learning | Aug 13, 2021 | Federated Learning | CodeCode Available | 2 |
| FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integration | Aug 13, 2021 | 3D Human Pose Estimation3D Human Reconstruction | CodeCode Available | 2 |
| Semi-Supervised Domain Generalizable Person Re-Identification | Aug 11, 2021 | Generalizable Person Re-identificationKnowledge Distillation | CodeCode Available | 2 |
| New strategies to improve minimap2 alignment accuracy | Aug 7, 2021 | | CodeCode Available | 2 |
| What Matters in Learning from Offline Human Demonstrations for Robot Manipulation | Aug 6, 2021 | Imitation Learningreinforcement-learning | CodeCode Available | 2 |
| Sequential Multivariate Change Detection with Calibrated and Memoryless False Detection Rates | Aug 2, 2021 | Change Detection | CodeCode Available | 2 |
| SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations | Aug 2, 2021 | DenoisingImage Generation | CodeCode Available | 2 |
| Ecco: An Open Source Library for the Explainability of Transformer Language Models | Aug 1, 2021 | Text Generation | CodeCode Available | 2 |
| Adaptive Optimizers with Sparse Group Lasso for Neural Networks in CTR Prediction | Jul 30, 2021 | Click-Through Rate Prediction | CodeCode Available | 2 |
| ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrations | Jul 30, 2021 | | CodeCode Available | 2 |
| Open-World Entity Segmentation | Jul 29, 2021 | Image ManipulationImage Segmentation | CodeCode Available | 2 |
| QuantumNAS: Noise-Adaptive Search for Robust Quantum Circuits | Jul 22, 2021 | | CodeCode Available | 2 |
| Polis: Scaling Deliberation by Mapping High Dimensional Opinion Spaces | Jul 22, 2021 | Data VisualizationDecision Making | CodeCode Available | 2 |
| Conditional GANs with Auxiliary Discriminative Classifier | Jul 21, 2021 | Conditional Image GenerationDiversity | CodeCode Available | 2 |
| Face.evoLVe: A High-Performance Face Recognition Library | Jul 19, 2021 | Face AlignmentFace Recognition | CodeCode Available | 2 |
| Deduplicating Training Data Makes Language Models Better | Jul 14, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| Per-Pixel Classification is Not All You Need for Semantic Segmentation | Jul 13, 2021 | AllClassification | CodeCode Available | 2 |
| Probabilistic Time Series Forecasting with Implicit Quantile Networks | Jul 8, 2021 | Probabilistic Time Series ForecastingTime Series | CodeCode Available | 2 |
| Structured Denoising Diffusion Models in Discrete State-Spaces | Jul 7, 2021 | DenoisingText Generation | CodeCode Available | 2 |
| Learning Semantic Segmentation of Large-Scale Point Clouds with Random Sampling | Jul 6, 2021 | SegmentationSemantic Segmentation | CodeCode Available | 2 |
| AutoFormer: Searching Transformers for Visual Recognition | Jul 1, 2021 | AutoMLFine-Grained Image Classification | CodeCode Available | 2 |
| Habitat 2.0: Training Home Assistants to Rearrange their Habitat | Jun 28, 2021 | Deep Reinforcement LearningGPU | CodeCode Available | 2 |
| Closed-form Continuous-time Neural Models | Jun 25, 2021 | FormSentiment Analysis | CodeCode Available | 2 |
| Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting | Jun 24, 2021 | Time SeriesTime Series Analysis | CodeCode Available | 2 |
| Brax -- A Differentiable Physics Engine for Large Scale Rigid Body Simulation | Jun 24, 2021 | MuJoCoOpenAI Gym | CodeCode Available | 2 |
| AudioCLIP: Extending CLIP to Image, Text and Audio | Jun 24, 2021 | ClassificationEnvironmental Sound Classification | CodeCode Available | 2 |
| Video Swin Transformer | Jun 24, 2021 | Action ClassificationAction Recognition | CodeCode Available | 2 |
| Transformer Meets Convolution: A Bilateral Awareness Network for Semantic Segmentation of Very Fine Resolution Urban Scene Images | Jun 23, 2021 | Autonomous DrivingDecision Making | CodeCode Available | 2 |
| Real-time Neural Radiance Caching for Path Tracing | Jun 23, 2021 | Neural Radiance Caching | CodeCode Available | 2 |
| NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction | Jun 20, 2021 | NeRFNovel View Synthesis | CodeCode Available | 2 |
| Learning Student Networks in the Wild | Jun 19, 2021 | Knowledge DistillationModel Compression | CodeCode Available | 2 |
| Rotation Invariant Graph Neural Networks using Spin Convolutions | Jun 17, 2021 | Graph Neural NetworkInitial Structure to Relaxed Energy (IS2RE) | CodeCode Available | 2 |
| LoRA: Low-Rank Adaptation of Large Language Models | Jun 17, 2021 | GPULanguage Modelling | CodeCode Available | 2 |
| An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models | Jun 17, 2021 | Hyperparameter Optimization | CodeCode Available | 2 |
| 2nd Place Solution for Waymo Open Dataset Challenge -- Real-time 2D Object Detection | Jun 16, 2021 | 2D Object DetectionAutonomous Driving | CodeCode Available | 2 |
| 2nd Place Solution for Waymo Open Dataset Challenge - Real-time 2D Object Detection | Jun 16, 2021 | 2D Object DetectionAutonomous Driving | CodeCode Available | 2 |
| Towards Total Recall in Industrial Anomaly Detection | Jun 15, 2021 | 3D Anomaly DetectionAnomaly Classification | CodeCode Available | 2 |
| BEiT: BERT Pre-Training of Image Transformers | Jun 15, 2021 | Document Image ClassificationDocument Layout Analysis | CodeCode Available | 2 |
| First Place Solution of KDD Cup 2021 & OGB Large-Scale Challenge Graph Prediction Track | Jun 15, 2021 | | CodeCode Available | 2 |
| Training Graph Neural Networks with 1000 Layers | Jun 14, 2021 | GPUGraph Sampling | CodeCode Available | 2 |
| GANs N' Roses: Stable, Controllable, Diverse Image to Image Translation (works for videos too!) | Jun 11, 2021 | Image-to-Image Translationmultimodal generation | CodeCode Available | 2 |
| DouZero: Mastering DouDizhu with Self-Play Deep Reinforcement Learning | Jun 11, 2021 | Card GamesDeep Reinforcement Learning | CodeCode Available | 2 |