Models
Datasets
Spaces
Docs
Enterprise
Pricing
Log In
Sign Up

Collections

Discover the best community collections!

Collections including paper arxiv:2107.00652

Papers - Image - Attention - Window

Vision Transformer with Quadrangle Attention

Paper • 2303.15105 • Published Mar 27, 2023 • 2
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows

Paper • 2103.14030 • Published Mar 25, 2021 • 5
MAFormer: A Transformer Network with Multi-scale Attention Fusion for Visual Recognition

Paper • 2209.01620 • Published Aug 31, 2022 • 2
CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

Paper • 2107.00652 • Published Jul 1, 2021 • 2

Papers - Image - Encoders

CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

Paper • 2107.00652 • Published Jul 1, 2021 • 2
Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Rendering

Paper • 2403.09622 • Published Mar 14, 2024 • 17
Veagle: Advancements in Multimodal Representation Learning

Paper • 2403.08773 • Published Jan 18, 2024 • 10
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality

Paper • 2304.14178 • Published Apr 27, 2023 • 3

FaceChain-SuDe: Building Derived Class to Inherit Category Attributes for One-shot Subject-Driven Generation

Paper • 2403.06775 • Published Mar 11, 2024 • 4
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Paper • 2010.11929 • Published Oct 22, 2020 • 15
Data Incubation -- Synthesizing Missing Data for Handwriting Recognition

Paper • 2110.07040 • Published Oct 13, 2021 • 2
A Mixture of Expert Approach for Low-Cost Customization of Deep Neural Networks

Paper • 1811.00056 • Published Oct 31, 2018 • 2

Papers - Image - Encoders - LePE - Local-Enhanced Pos Enc

CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

Paper • 2107.00652 • Published Jul 1, 2021 • 2

Papers - Image - CSWin - Cross-Shaped Windows

CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

Paper • 2107.00652 • Published Jul 1, 2021 • 2
Cross-Shaped Windows Transformer with Self-supervised Pretraining for Clinically Significant Prostate Cancer Detection in Bi-parametric MRI

Paper • 2305.00385 • Published Apr 30, 2023 • 2
2nd Place Solution to Google Landmark Recognition Competition 2021

Paper • 2110.02638 • Published Oct 6, 2021 • 2
BOAT: Bilateral Local Attention Vision Transformer

Paper • 2201.13027 • Published Jan 31, 2022 • 2

Papers - Attention

Linear Transformers with Learnable Kernel Functions are Better In-Context Models

Paper • 2402.10644 • Published Feb 16, 2024 • 81
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

Paper • 2305.13245 • Published May 22, 2023 • 6
ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition

Paper • 2402.15220 • Published Feb 23, 2024 • 20
Sequence Parallelism: Long Sequence Training from System Perspective

Paper • 2105.13120 • Published May 26, 2021 • 6

Papers - Image - Attention - Window

Vision Transformer with Quadrangle Attention

Paper • 2303.15105 • Published Mar 27, 2023 • 2
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows

Paper • 2103.14030 • Published Mar 25, 2021 • 5
MAFormer: A Transformer Network with Multi-scale Attention Fusion for Visual Recognition

Paper • 2209.01620 • Published Aug 31, 2022 • 2
CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

Paper • 2107.00652 • Published Jul 1, 2021 • 2

Papers - Image - Encoders - LePE - Local-Enhanced Pos Enc

CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

Paper • 2107.00652 • Published Jul 1, 2021 • 2

Papers - Image - Encoders

CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

Paper • 2107.00652 • Published Jul 1, 2021 • 2
Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Rendering

Paper • 2403.09622 • Published Mar 14, 2024 • 17
Veagle: Advancements in Multimodal Representation Learning

Paper • 2403.08773 • Published Jan 18, 2024 • 10
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality

Paper • 2304.14178 • Published Apr 27, 2023 • 3

Papers - Image - CSWin - Cross-Shaped Windows

CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows

Paper • 2107.00652 • Published Jul 1, 2021 • 2
Cross-Shaped Windows Transformer with Self-supervised Pretraining for Clinically Significant Prostate Cancer Detection in Bi-parametric MRI

Paper • 2305.00385 • Published Apr 30, 2023 • 2
2nd Place Solution to Google Landmark Recognition Competition 2021

Paper • 2110.02638 • Published Oct 6, 2021 • 2
BOAT: Bilateral Local Attention Vision Transformer

Paper • 2201.13027 • Published Jan 31, 2022 • 2

FaceChain-SuDe: Building Derived Class to Inherit Category Attributes for One-shot Subject-Driven Generation

Paper • 2403.06775 • Published Mar 11, 2024 • 4
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Paper • 2010.11929 • Published Oct 22, 2020 • 15
Data Incubation -- Synthesizing Missing Data for Handwriting Recognition

Paper • 2110.07040 • Published Oct 13, 2021 • 2
A Mixture of Expert Approach for Low-Cost Customization of Deep Neural Networks

Paper • 1811.00056 • Published Oct 31, 2018 • 2

Papers - Attention

Linear Transformers with Learnable Kernel Functions are Better In-Context Models

Paper • 2402.10644 • Published Feb 16, 2024 • 81
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

Paper • 2305.13245 • Published May 22, 2023 • 6
ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition

Paper • 2402.15220 • Published Feb 23, 2024 • 20
Sequence Parallelism: Long Sequence Training from System Perspective

Paper • 2105.13120 • Published May 26, 2021 • 6

Company

TOS Privacy About Careers

Website

Models Datasets Spaces Pricing Docs