English注册

Ruggero1912/Patch-ioner_talk2dino_capdec_groupnet_COCO_Captions

🤗 Hugging Face 来源image-to-textapache-2.0302 MBother✓ 3 个校验和今天更新
一条命令提交

在你的模型文件夹旁边运行它。它会制作种子、将文件与 Hugging Face 比对，然后提交。你只需开始做种，并粘贴你账户中的密钥。它只读取你的文件，绝不修改。如果愿意，可以先阅读脚本。

curl -fsSL https://pirateface.co/package.sh | bash -s -- --repo Ruggero1912/Patch-ioner_talk2dino_capdec_groupnet_COCO_Captions ./model-folder
需要做种者 →

Patch-ioner_talk2dino_capdec_groupnet_COCO_Captions - Patch-ioner Configuration

This repository contains a pre-trained DECAP model from the Patch-ioner framework for dense image captioning and controllable visual description.

📝 Paper Information

Title: "One Patch to Caption Them All: A Unified Zero-Shot Captioning Framework"
Authors: Lorenzo Bianchi, Giacomo Pacini, Fabio Carrara, Nicola Messina, Giuseppe Amato, Fabrizio Falchi
ArXiv: https://arxiv.org/abs/2510.02898 Project Page: https://paciosoft.com/Patch-ioner/

🎯 Model Overview

  • Model Type: DECAP
  • Configuration: mlp_noise.k.groupnet.yaml
  • Vision Backbone: dinov2_vitb14_reg
  • Language Model: GPT-2
  • Input Resolution: 518x518
  • Prefix Size: 768

DeCap Configuration

  • Memory Bank: Not used
  • Projection Type: coco
  • Linear Talk2DINO: False

📊 Performance

Task METEOR CIDEr SPICE
Image Captioning nan N/A nan
Narratives 10.100 38.307 66.297

📈 Detailed Results

Image Captioning Results

  • METEOR: nan
  • SPICE: nan
  • BLEU_4: nan
  • ROUGE_L: nan

Narratives Results

  • METEOR: 10.1000
  • CIDEr: 38.3069
  • SPICE: 66.2970
  • BLEU_4: 8.9000
  • ROUGE_L: 8.6000
  • CLIP-S: 7.9000

🚀 Quick Start

from patch_ioner import load_model, Patchioner

# Load the model
config_path = "config.yaml"
model = load_model(config_path)

# Run inference
image_path = "your_image.jpg"
results = model.forward(image_path)
print(results)

📁 Repository Contents

  • config.yaml: Model configuration file
  • coco_karpathy-009.pt: Pre-trained model weights
  • README.md: This file

🔧 Installation

pip install git+https://github.com/Ruggero1912/Patch-ioner

💡 Usage Examples

Refer to the Patch-ioner repository for updated usage examples.

🎛️ Model Configuration

  • Prefix Size: 768
  • Memory Bank Size: 0
  • Normalization: True

📈 Training Details

  • Training Dataset: COCO Captions
  • Training Epochs: TBD
  • Batch Size: TBD
  • Learning Rate: TBD
  • Optimizer: AdamW

📚 Citation

If you use this model in your research, please cite our paper, refer to the Project Page for updated citation template.

🤝 Contributing

We welcome contributions to improve the Patch-ioner framework. Please see the main repository for contribution guidelines.

📄 License

See the main repository for detailed license information.

🐛 Issues and Support

For issues related to this model or the Patch-ioner framework, please:

  1. Check the main repository for existing issues
  2. Open a new issue with detailed information about your problem
  3. Contact the authors.

🔗 Related Models

Explore other Patch-ioner model configurations:

More models available in Ruggero1912's models

This model is part of the Patch-ioner framework for dense image captioning and controllable visual description.