SOTAVerified

Medical Report Generation

Medical report generation (MRG) is a task which focus on training AI to automatically generate professional report according the input image data. This can help clinicians make faster and more accurate decision since the task itself is both time consuming and error prone even for experienced doctors.

Aggfgg

Deep neural network and transformer based architecture are currently the most popular methods for this certain task, however, when we try to transfer out pre-trained model into this certain domain, their performance always degrade.

The following are some of the reasons why RSG is hard for pre-trained models:

  • Language datasets in a particular domain can sometimes be quite different from the large number of datasets available on the Internet
  • During the fine-tuning phase, datasets in the medical field are often unevenly distributed

More recently, multi-modal learning and contrastive learning have shown some inspiring results in this field, but it's still challenging and requires further attention.

Here are some additional readings to go deeper on the task:

https://arxiv.org/abs/2004.12150

(Image credit : Transformers in Medical Imaging: A Survey)

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–75 of 110 papers

TitleStatusHype
Reinforcement Learning with Imbalanced Dataset for Data-to-Text Medical Report Generation—0
Representative Image Feature Extraction via Contrastive Learning Pretraining for Chest X-ray Report Generation—0
Resource-Efficient Medical Report Generation using Large Language Models—0
Retrieval Instead of Fine-tuning: A Retrieval-based Parameter Ensemble for Zero-shot Learning—0
The Potential of LLMs in Medical Education: Generating Questions and Answers for Qualification Exams—0
Topicwise Separable Sentence Retrieval for Medical Report Generation—0
Towards a HIPAA Compliant Agentic AI System in Healthcare—0
Towards Building Automatic Medical Consultation System: Framework, Task and Dataset—0
Unifying Neural Learning and Symbolic Reasoning for Spinal Medical Report Generation—0
Unmasking and Quantifying Racial Bias of Large Language Models in Medical Report Generation—0
Visual-Textual Attentive Semantic Consistency for Medical Report Generation—0
ViT3D Alignment of LLaMA3: 3D Medical Image Report Generation—0
MedUnifier: Unifying Vision-and-Language Pre-training on Medical Data with Vision Generation Task using Discrete Visual Representations—0
Writing by Memorizing: Hierarchical Retrieval-based Medical Report Generation—0
Addressing Data Bias Problems for Chest X-ray Image Report Generation—0
A Labeled Ophthalmic Ultrasound Dataset with Medical Report Generation Based on Cross-modal Deep Learning—0
AlignTransformer: Hierarchical Alignment of Visual Regions and Disease Tags for Medical Report Generation—0
A Medical Semantic-Assisted Transformer for Radiographic Report Generation—0
A Self-Boosting Framework for Automated Radiographic Report Generation—0
A Self-Guided Framework for Radiology Report Generation—0
A Survey on Deep Learning and Explainability for Automatic Report Generation from Medical Images—0
A Survey on Trustworthiness in Foundation Models for Medical Image Analysis—0
Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generation—0
Automatic Medical Report Generation: Methods and Applications—0
Boosting Radiology Report Generation by Infusing Comparison Prior—0
Show:102550
← PrevPage 3 of 5Next →
All datasetsMIMIC-CXRHistGen WSI-Report DatasetIU X-Ray

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1RGRGBLEU-137.3—Unverified
2SEI-1BLEU-20.25—Unverified
#ModelMetricClaimedVerifiedStatus
1HistGenBLEU-40.18—Unverified
#ModelMetricClaimedVerifiedStatus
1X-RGenBLEU-40.18—Unverified