ONNX Version for pixai-labs/pixai-tagger-v0.9

This is the ONNX-exported version of PixAI's tagger pixai-labs/pixai-tagger-v0.9.

Model Details

Model Type: Multilabel Image classification / feature backbone
Model Stats:
- Params: 317.9M
- FLOPs / MACs: 620.9G / 310.1G
- Image size: 448 x 448
- Tags Count: 13461
  - General (#0) Tags Count: 9741
  - Character (#4) Tags Count: 3720

Thresholds

Category	Name	Count	Threshold
0	general	9741	0.3
4	character	3720	0.85

How to Use

We provided a sample image for our code samples, you can find it here.

Install dghs-imgutils with the following command

pip install 'dghs-imgutils>=0.19.0' torch huggingface_hub timm pillow pandas

You can use function get_pixai_tags to tag your image. For more details of this function, see documentation of imgutils.tagging.pixai.

from imgutils.tagging import get_pixai_tags

general, character, ips, ips_mapping = get_pixai_tags(
    'https://huggingface.co/deepghs/pixai-tagger-v0.9-onnx/resolve/main/sample.webp',
    model_name='v0.9',
    fmt=('general', 'character', 'ips', 'ips_mapping'),
)

print(general)
# {'symbol-shaped_pupils': 0.9940369129180908,
#  'ghost': 0.9908503890037537,
#  'flower-shaped_pupils': 0.9783934354782104,
#  'black_nails': 0.9721313118934631,
#  'porkpie_hat': 0.964271068572998,
#  'ghost_pose': 0.9570443630218506,
#  'ring': 0.9521543979644775,
#  '1girl': 0.9491472244262695,
#  'hat': 0.9321512579917908,
#  'hat_flower': 0.9310178756713867,
#  'flower': 0.9181427955627441,
#  'plum_blossoms': 0.8758766651153564,
#  'red_shirt': 0.8587117195129395,
#  'jewelry': 0.8488669395446777,
#  'chinese_clothes': 0.8235750198364258,
#  'claw_pose': 0.8184436559677124,
#  'long_sleeves': 0.8045806884765625,
#  'twintails': 0.7922596335411072,
#  'hat_tassel': 0.7861523628234863,
#  'long_hair': 0.7857427597045898,
#  'looking_at_viewer': 0.7703293561935425,
#  'multiple_rings': 0.7530679106712341,
#  'signature': 0.7448598146438599,
#  'smile': 0.7411079406738281,
#  'open_mouth': 0.7243687510490417,
#  'red_flower': 0.6929515600204468,
#  'solo': 0.6898764371871948,
#  'hat_ornament': 0.6630162000656128,
#  'red_eyes': 0.6534468531608582,
#  'black_hat': 0.6130237579345703,
#  'nail_polish': 0.600890576839447,
#  'brown_coat': 0.5587427616119385,
#  'coat': 0.5543128848075867,
#  'upper_body': 0.5307736396789551,
#  'thumb_ring': 0.5169675350189209,
#  'brown_hair': 0.5059547424316406,
#  'star_(symbol)': 0.48425528407096863,
#  'star-shaped_pupils': 0.46570321917533875,
#  'shirt': 0.44571059942245483,
#  'hair_between_eyes': 0.4336400330066681,
#  ':d': 0.40481746196746826,
#  'orange_eyes': 0.3937417268753052,
#  ':3': 0.38414278626441956,
#  'tangzhuang': 0.37281090021133423,
#  'blush': 0.36003637313842773,
#  'sidelocks': 0.3363075256347656,
#  'v-shaped_eyebrows': 0.3265596628189087,
#  'blurry': 0.30306869745254517}

print(character)
# {'hu_tao_(genshin_impact)': 0.9999701380729675,
#  'boo_tao_(genshin_impact)': 0.9996192455291748}

print(ips)
# ['genshin_impact']

print(ips_mapping)
# {'hu_tao_(genshin_impact)': ['genshin_impact'],
#  'boo_tao_(genshin_impact)': ['genshin_impact']}

加载中…

Category

Name

Count

Threshold

general

9741

0.3

character

3720

0.85

How to Use

We provided a sample image for our code samples, you can find it here.

Install dghs-imgutils with the following command

pip install 'dghs-imgutils>=0.19.0' torch huggingface_hub timm pillow pandas

You can use function get_pixai_tags to tag your image. For more details of this function, see documentation of imgutils.tagging.pixai.

from imgutils.tagging import get_pixai_tags general, character, ips, ips_mapping = get_pixai_tags( 'https://huggingface.co/deepghs/pixai-tagger-v0.9-onnx/resolve/main/sample.webp', model_name='v0.9', fmt=('general', 'character', 'ips', 'ips_mapping'), ) print(general) # {'symbol-shaped_pupils': 0.9940369129180908, # 'ghost': 0.9908503890037537, # 'flower-shaped_pupils': 0.9783934354782104, # 'black_nails': 0.9721313118934631, # 'porkpie_hat': 0.964271068572998, # 'ghost_pose': 0.9570443630218506, # 'ring': 0.9521543979644775, # '1girl': 0.9491472244262695, # 'hat': 0.9321512579917908, # 'hat_flower': 0.9310178756713867, # 'flower': 0.9181427955627441, # 'plum_blossoms': 0.8758766651153564, # 'red_shirt': 0.8587117195129395, # 'jewelry': 0.8488669395446777, # 'chinese_clothes': 0.8235750198364258, # 'claw_pose': 0.8184436559677124, # 'long_sleeves': 0.8045806884765625, # 'twintails': 0.7922596335411072, # 'hat_tassel': 0.7861523628234863, # 'long_hair': 0.7857427597045898, # 'looking_at_viewer': 0.7703293561935425, # 'multiple_rings': 0.7530679106712341, # 'signature': 0.7448598146438599, # 'smile': 0.7411079406738281, # 'open_mouth': 0.7243687510490417, # 'red_flower': 0.6929515600204468, # 'solo': 0.6898764371871948, # 'hat_ornament': 0.6630162000656128, # 'red_eyes': 0.6534468531608582, # 'black_hat': 0.6130237579345703, # 'nail_polish': 0.600890576839447, # 'brown_coat': 0.5587427616119385, # 'coat': 0.5543128848075867, # 'upper_body': 0.5307736396789551, # 'thumb_ring': 0.5169675350189209, # 'brown_hair': 0.5059547424316406, # 'star_(symbol)': 0.48425528407096863, # 'star-shaped_pupils': 0.46570321917533875, # 'shirt': 0.44571059942245483, # 'hair_between_eyes': 0.4336400330066681, # ':d': 0.40481746196746826, # 'orange_eyes': 0.3937417268753052, # ':3': 0.38414278626441956, # 'tangzhuang': 0.37281090021133423, # 'blush': 0.36003637313842773, # 'sidelocks': 0.3363075256347656, # 'v-shaped_eyebrows': 0.3265596628189087, # 'blurry': 0.30306869745254517} print(character) # {'hu_tao_(genshin_impact)': 0.9999701380729675, # 'boo_tao_(genshin_impact)': 0.9996192455291748} print(ips) # ['genshin_impact'] print(ips_mapping) # {'hu_tao_(genshin_impact)': ['genshin_impact'], # 'boo_tao_(genshin_impact)': ['genshin_impact']}