Referring expression generation

Generate referring expressions

Papers

Recently Added Most Hyped Most Active Needs Verification Most Verified

Showing 1–25 of 84 papers

Title	Date	Tasks	Status	Hype
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models	Mar 27, 2024	Image ClassificationImage Comprehension	CodeCode Available	7
MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning	Oct 14, 2023	Image ClassificationImage Description	CodeCode Available	7
Visual Instruction Tuning	Apr 17, 2023	1 Image, 2*2 Stitching3D Question Answering (3D-QA)	CodeCode Available	6
Improved Baselines with Visual Instruction Tuning	Oct 5, 2023	Factual Inconsistency Detection in Chart CaptioningImage Classification	CodeCode Available	6
Efficient Multimodal Learning from Data-centric Perspective	Feb 18, 2024	Image ClassificationReferring Expression Comprehension	CodeCode Available	5
LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day	Jun 1, 2023	Image ClassificationInstruction Following	CodeCode Available	4
MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devices	Dec 28, 2023	AutoMLCPU	CodeCode Available	3
Elysium: Exploring Object-level Perception in Videos via MLLM	Mar 25, 2024	ObjectObject Tracking	CodeCode Available	2
Frontiers in Intelligent Colonoscopy	Oct 22, 2024	Image Captioning	CodeCode Available	2
GLaMM: Pixel Grounding Large Multimodal Model	Nov 6, 2023	Conversational Question AnsweringImage Captioning	CodeCode Available	2
Multi-modal Instruction Tuned LLMs with Fine-grained Visual Perception	Mar 5, 2024	Language ModelingLanguage Modelling	CodeCode Available	1
Modeling Context in Referring Expressions	Jul 31, 2016	Referring ExpressionReferring expression generation	CodeCode Available	1
Kosmos-2: Grounding Multimodal Large Language Models to the World	Jun 26, 2023	Image CaptioningIn-Context Learning	CodeCode Available	1
Uni-Med: A Unified Medical Generalist Foundation Model For Multi-Task Learning Via Connector-MoE	Sep 26, 2024	image-classificationImage Classification	CodeCode Available	1
Decoding Strategies for Neural Referring Expression Generation	Nov 1, 2018	Image CaptioningMachine Translation	—Unverified	0
Creating Training Corpora for NLG Micro-Planners	Jul 1, 2017	Data-to-Text GenerationReferring Expression	—Unverified	0
Assessing Neural Referential Form Selectors on a Realistic Multilingual Dataset	Oct 10, 2022	FormReferring Expression	—Unverified	0
CoNAN: A Complementary Neighboring-based Attention Network for Referring Expression Generation	Dec 1, 2020	ObjectReferring Expression	—Unverified	0
Comprehension-guided referring expressions	Jan 12, 2017	Referring ExpressionReferring expression generation	—Unverified	0
A Predictive Model for Notional Anaphora in English	Apr 19, 2018	coreference-resolutionCoreference Resolution	—Unverified	0
Adapting Descriptions of People to the Point of View of a Moving Observer	Nov 1, 2018	PositionReferring Expression	—Unverified	0
Exploring the Behavior of Classic REG Algorithms in the Description of Characters in 3D Images	Sep 1, 2017	Image DescriptionReferring Expression	—Unverified	0
Combining Referring Expression Generation and Surface Realization: A Corpus-Based Investigation of Architectures	Aug 1, 2013	Referring ExpressionReferring expression generation	—Unverified	0
Fuzzy Logic for Vagueness Management in Referring Expression Generation	Sep 1, 2020	ManagementReferring Expression	—Unverified	0
Generating Quantified Referring Expressions through Attention-Driven Incremental Perception	Dec 1, 2020	Referring ExpressionReferring expression generation	—Unverified	0

Show:10 25 50

← PrevPage 1 of 4Next →

All datasets ColonINST-v1 (Seen)ColonINST-v1 (Unseen)

Benchmark Results

#	Model	Metric	Claimed	Verified	Status
1	ColonGPT (w/ LoRA, w/o extra data)	Accuray	99.96	—	Unverified
2	LLaVA-v1.5 (w/ LoRA, w/ extra data)	Accuray	99.32	—	Unverified
3	LLaVA-Med-v1.5 (w/ LoRA, w/o extra data)	Accuray	99.3	—	Unverified
4	MGM-2B (w/o LoRA, w/ extra data)	Accuray	98.75	—	Unverified
5	LLaVA-v1.5 (w/ LoRA, w/o extra data)	Accuray	98.58	—	Unverified
6	MGM-2B (w/o LoRA, w/o extra data)	Accuray	98.17	—	Unverified
7	MobileVLM-1.7B (w/ LoRA, w/ extra data)	Accuray	97.87	—	Unverified
8	MobileVLM-1.7B (w/o LoRA, w/ extra data)	Accuray	97.78	—	Unverified
9	LLaVA-Med-v1.0 (w/o LoRA, w/o extra data)	Accuray	97.74	—	Unverified
10	LLaVA-Med-v1.0 (w/o LoRA, w/ extra data)	Accuray	97.35	—	Unverified

#	Model	Metric	Claimed	Verified	Status
1	LLaVA-Med-v1.5 (w/ LoRA, w/ extra data)	Accuray	70	—	Unverified
2	LLaVA-v1 (w/ LoRA, w/ extra data)	Accuray	46.85	—	Unverified