Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

Darkscribes Community

  1. Home
  2. Uncategorized
  3. As someone who has developed several #ActivityPub software implementations ([Fedify], [Hollo], [BotKit], and [Hackers' Pub]), I believe one of the most frustrating features to implement in the #fediverse is #custom_emoji.

As someone who has developed several #ActivityPub software implementations ([Fedify], [Hollo], [BotKit], and [Hackers' Pub]), I believe one of the most frustrating features to implement in the #fediverse is #custom_emoji.

Scheduled Pinned Locked Moved Uncategorized
fedidevfediverseactivitypubcustomemojiaccessibility
16 Posts 6 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • hongminhee@hollo.socialH This user is from outside of this forum
    hongminhee@hollo.socialH This user is from outside of this forum
    [email protected]
    wrote last edited by
    #1

    As someone who has developed several #ActivityPub software implementations (Fedify, Hollo, BotKit, and Hackers' Pub), I believe one of the most frustrating features to implement in the #fediverse is #custom_emoji.

    The challenges are numerous:

    First, there's no standardization. ActivityPub specifications don't define how custom emoji should work, leading to inconsistent implementations across different servers like Mastodon and Misskey.

    Rendering is particularly problematic. Emojis must display properly across different contexts (in text, as reactions, in emoji pickers) while maintaining quality at various sizes. Animated emojis add another layer of complexity.

    Perhaps most concerning is the poor #accessibility. Most implementations simply use the emoji code (like :party_blob:) as the alt text, which provides no meaningful information to screen reader users (in particular, non-English speakers) about what the emoji actually depicts or means.

    What really dampens my motivation to implement this feature is knowing I'm investing significant effort into something that ultimately creates accessibility barriers. It's disheartening to work hard on a feature that excludes part of the community.

    #fedidev

    liaizon@social.wake.stL thisismissem@hachyderm.ioT mariusor@metalhead.clubM silverpill@mitra.socialS 4 Replies Last reply
    0
    • hongminhee@hollo.socialH [email protected]

      As someone who has developed several #ActivityPub software implementations (Fedify, Hollo, BotKit, and Hackers' Pub), I believe one of the most frustrating features to implement in the #fediverse is #custom_emoji.

      The challenges are numerous:

      First, there's no standardization. ActivityPub specifications don't define how custom emoji should work, leading to inconsistent implementations across different servers like Mastodon and Misskey.

      Rendering is particularly problematic. Emojis must display properly across different contexts (in text, as reactions, in emoji pickers) while maintaining quality at various sizes. Animated emojis add another layer of complexity.

      Perhaps most concerning is the poor #accessibility. Most implementations simply use the emoji code (like :party_blob:) as the alt text, which provides no meaningful information to screen reader users (in particular, non-English speakers) about what the emoji actually depicts or means.

      What really dampens my motivation to implement this feature is knowing I'm investing significant effort into something that ultimately creates accessibility barriers. It's disheartening to work hard on a feature that excludes part of the community.

      #fedidev

      liaizon@social.wake.stL This user is from outside of this forum
      liaizon@social.wake.stL This user is from outside of this forum
      [email protected]
      wrote last edited by
      #2

      @hongminhee let's make a new standard for adding metadata to emojos! I think there is enough motivation around this feature to get the various implementors to add new stuff to it!

      hongminhee@hollo.socialH 1 Reply Last reply
      0
      • liaizon@social.wake.stL [email protected]

        @hongminhee let's make a new standard for adding metadata to emojos! I think there is enough motivation around this feature to get the various implementors to add new stuff to it!

        hongminhee@hollo.socialH This user is from outside of this forum
        hongminhee@hollo.socialH This user is from outside of this forum
        [email protected]
        wrote last edited by
        #3

        @[email protected] I appreciate the enthusiasm, but I personally don't have much motivation to standardize custom emoji. While I understand many people enjoy this feature, I'm not particularly fond of custom emoji functionality in general. My limited interest in the feature itself, combined with the significant accessibility issues it creates, makes it difficult for me to get excited about investing time in standardization efforts. Though I respect that others might feel differently!

        mariusor@metalhead.clubM 1 Reply Last reply
        0
        • hongminhee@hollo.socialH [email protected]

          As someone who has developed several #ActivityPub software implementations (Fedify, Hollo, BotKit, and Hackers' Pub), I believe one of the most frustrating features to implement in the #fediverse is #custom_emoji.

          The challenges are numerous:

          First, there's no standardization. ActivityPub specifications don't define how custom emoji should work, leading to inconsistent implementations across different servers like Mastodon and Misskey.

          Rendering is particularly problematic. Emojis must display properly across different contexts (in text, as reactions, in emoji pickers) while maintaining quality at various sizes. Animated emojis add another layer of complexity.

          Perhaps most concerning is the poor #accessibility. Most implementations simply use the emoji code (like :party_blob:) as the alt text, which provides no meaningful information to screen reader users (in particular, non-English speakers) about what the emoji actually depicts or means.

          What really dampens my motivation to implement this feature is knowing I'm investing significant effort into something that ultimately creates accessibility barriers. It's disheartening to work hard on a feature that excludes part of the community.

          #fedidev

          thisismissem@hachyderm.ioT This user is from outside of this forum
          thisismissem@hachyderm.ioT This user is from outside of this forum
          [email protected]
          wrote last edited by
          #4

          @hongminhee sounds like there needs to be a better FEP written, one which encourages alt text for custom emojis?

          hongminhee@hollo.socialH 1 Reply Last reply
          0
          • thisismissem@hachyderm.ioT [email protected]

            @hongminhee sounds like there needs to be a better FEP written, one which encourages alt text for custom emojis?

            hongminhee@hollo.socialH This user is from outside of this forum
            hongminhee@hollo.socialH This user is from outside of this forum
            [email protected]
            wrote last edited by
            #5

            @[email protected] Yeah, if it's standardized al text should be considered…

            thisismissem@hachyderm.ioT 1 Reply Last reply
            0
            • hongminhee@hollo.socialH [email protected]

              @[email protected] Yeah, if it's standardized al text should be considered…

              thisismissem@hachyderm.ioT This user is from outside of this forum
              thisismissem@hachyderm.ioT This user is from outside of this forum
              [email protected]
              wrote last edited by
              #6

              @hongminhee I know there's a FEP for emoji reactions, but I don't think there's ever been one for custom emojis? https://codeberg.org/fediverse/fep/src/branch/main/fep/c0e0/fep-c0e0.md

              1 Reply Last reply
              0
              • hongminhee@hollo.socialH [email protected]

                As someone who has developed several #ActivityPub software implementations (Fedify, Hollo, BotKit, and Hackers' Pub), I believe one of the most frustrating features to implement in the #fediverse is #custom_emoji.

                The challenges are numerous:

                First, there's no standardization. ActivityPub specifications don't define how custom emoji should work, leading to inconsistent implementations across different servers like Mastodon and Misskey.

                Rendering is particularly problematic. Emojis must display properly across different contexts (in text, as reactions, in emoji pickers) while maintaining quality at various sizes. Animated emojis add another layer of complexity.

                Perhaps most concerning is the poor #accessibility. Most implementations simply use the emoji code (like :party_blob:) as the alt text, which provides no meaningful information to screen reader users (in particular, non-English speakers) about what the emoji actually depicts or means.

                What really dampens my motivation to implement this feature is knowing I'm investing significant effort into something that ultimately creates accessibility barriers. It's disheartening to work hard on a feature that excludes part of the community.

                #fedidev

                mariusor@metalhead.clubM This user is from outside of this forum
                mariusor@metalhead.clubM This user is from outside of this forum
                [email protected]
                wrote last edited by
                #7

                @hongminhee I would do the same thing I do for images right now: I add a summary field on the ActivityPub object that designates the image/svg, which then gets translated into an alt text when rendered into HTML. See this as an example: https://marius.federated.id/outbox/1743586392386 (this is an ActivityPub Create for that Image that you see). If you access the object of the Create you get just the plain binary image, but so encapsulated it renders with the alt text.

                1 Reply Last reply
                0
                • hongminhee@hollo.socialH [email protected]

                  @[email protected] I appreciate the enthusiasm, but I personally don't have much motivation to standardize custom emoji. While I understand many people enjoy this feature, I'm not particularly fond of custom emoji functionality in general. My limited interest in the feature itself, combined with the significant accessibility issues it creates, makes it difficult for me to get excited about investing time in standardization efforts. Though I respect that others might feel differently!

                  mariusor@metalhead.clubM This user is from outside of this forum
                  mariusor@metalhead.clubM This user is from outside of this forum
                  [email protected]
                  wrote last edited by
                  #8

                  @hongminhee @liaizon I've never really got to the point to add custom emojis for my projects, but I think they as a concept work really well on top of ActivityPub in the form of "Like" activities which have a URL (or even maybe a binary Content directly) to the actual emoji image, but also support alternate text as I described in my sibling message.

                  1 Reply Last reply
                  0
                  • hongminhee@hollo.socialH [email protected]

                    As someone who has developed several #ActivityPub software implementations (Fedify, Hollo, BotKit, and Hackers' Pub), I believe one of the most frustrating features to implement in the #fediverse is #custom_emoji.

                    The challenges are numerous:

                    First, there's no standardization. ActivityPub specifications don't define how custom emoji should work, leading to inconsistent implementations across different servers like Mastodon and Misskey.

                    Rendering is particularly problematic. Emojis must display properly across different contexts (in text, as reactions, in emoji pickers) while maintaining quality at various sizes. Animated emojis add another layer of complexity.

                    Perhaps most concerning is the poor #accessibility. Most implementations simply use the emoji code (like :party_blob:) as the alt text, which provides no meaningful information to screen reader users (in particular, non-English speakers) about what the emoji actually depicts or means.

                    What really dampens my motivation to implement this feature is knowing I'm investing significant effort into something that ultimately creates accessibility barriers. It's disheartening to work hard on a feature that excludes part of the community.

                    #fedidev

                    silverpill@mitra.socialS This user is from outside of this forum
                    silverpill@mitra.socialS This user is from outside of this forum
                    [email protected]
                    wrote last edited by
                    #9

                    @hongminhee I plan to write a FEP documenting existing implementations (it is needed to finalize my emoji reactions FEP).

                    >Most implementations simply use the emoji code (like :party_blob:) as the alt text, which provides no meaningful information to screen reader users

                    Do you know implementations that provide alt text for custom emojis?

                    julian@community.nodebb.orgJ 1 Reply Last reply
                    0
                    • silverpill@mitra.socialS [email protected]

                      @hongminhee I plan to write a FEP documenting existing implementations (it is needed to finalize my emoji reactions FEP).

                      >Most implementations simply use the emoji code (like :party_blob:) as the alt text, which provides no meaningful information to screen reader users

                      Do you know implementations that provide alt text for custom emojis?

                      julian@community.nodebb.orgJ This user is from outside of this forum
                      julian@community.nodebb.orgJ This user is from outside of this forum
                      [email protected]
                      wrote last edited by
                      #10

                      @[email protected] I personally didn't find integrating custom emoji to be difficult at all.

                      However NodeBB did already have custom emoji support (so it was fairly straightforward to add the outbound federation support), and as for inbound, the short code is defined in the payload and a simple regex replace handles it ok.

                      Sure, some emoji might look weird if they have different aspect ratios, but that's something outside the scope of what I'd want. All remote emoji are reduced down to a small square (or technically I think it's maybe max width and height of 1rem or similar), inline with the text and that honestly works with like 99% of the emoji I see.

                      cc @[email protected]

                      julian@community.nodebb.orgJ 1 Reply Last reply
                      0
                      • julian@community.nodebb.orgJ [email protected]

                        @[email protected] I personally didn't find integrating custom emoji to be difficult at all.

                        However NodeBB did already have custom emoji support (so it was fairly straightforward to add the outbound federation support), and as for inbound, the short code is defined in the payload and a simple regex replace handles it ok.

                        Sure, some emoji might look weird if they have different aspect ratios, but that's something outside the scope of what I'd want. All remote emoji are reduced down to a small square (or technically I think it's maybe max width and height of 1rem or similar), inline with the text and that honestly works with like 99% of the emoji I see.

                        cc @[email protected]

                        julian@community.nodebb.orgJ This user is from outside of this forum
                        julian@community.nodebb.orgJ This user is from outside of this forum
                        [email protected]
                        wrote last edited by
                        #11

                        That said an FEP would be nice so I'd be able to verify that my implementation checks all the boxes.

                        1 Reply Last reply
                        0
                        • hongminhee@hollo.socialH This user is from outside of this forum
                          hongminhee@hollo.socialH This user is from outside of this forum
                          [email protected]
                          wrote last edited by
                          #12

                          Another annoying thing about the current custom emoji spec in the fediverse: the type is just called Emoji instead of CustomEmoji. Such a small detail, but it creates unnecessary ambiguity between Unicode emojis and custom ones. I ran into this while implementing BotKit and had type name collisions with Emoji—had to use awkward namespacing to work around it. These little inconsistencies make implementation more tedious than it needs to be.

                          silverpill@mitra.socialS 1 Reply Last reply
                          0
                          • silverpill@mitra.socialS This user is from outside of this forum
                            silverpill@mitra.socialS This user is from outside of this forum
                            [email protected]
                            wrote last edited by
                            #13

                            @julian @hongminhee

                            Started writing it

                            https://codeberg.org/silverpill/feps/src/branch/main/9098/fep-9098.md

                            Listed requirements for the Emoji object.
                            I should probably describe the microsynax there as well, and how custom emojis are rendered.

                            liaizon@social.wake.stL 1 Reply Last reply
                            0
                            • hongminhee@hollo.socialH [email protected]

                              Another annoying thing about the current custom emoji spec in the fediverse: the type is just called Emoji instead of CustomEmoji. Such a small detail, but it creates unnecessary ambiguity between Unicode emojis and custom ones. I ran into this while implementing BotKit and had type name collisions with Emoji—had to use awkward namespacing to work around it. These little inconsistencies make implementation more tedious than it needs to be.

                              silverpill@mitra.socialS This user is from outside of this forum
                              silverpill@mitra.socialS This user is from outside of this forum
                              [email protected]
                              wrote last edited by
                              #14

                              @hongminhee Why there are collisions? Do you generate Emoji objects for unicode emojis too?

                              1 Reply Last reply
                              0
                              • silverpill@mitra.socialS [email protected]

                                @julian @hongminhee

                                Started writing it

                                https://codeberg.org/silverpill/feps/src/branch/main/9098/fep-9098.md

                                Listed requirements for the Emoji object.
                                I should probably describe the microsynax there as well, and how custom emojis are rendered.

                                liaizon@social.wake.stL This user is from outside of this forum
                                liaizon@social.wake.stL This user is from outside of this forum
                                [email protected]
                                wrote last edited by
                                #15

                                @silverpill @julian @hongminhee you have listed "Image is a square" but is definitely not true for Misskey. And Mastodon renders Misskeys long emojos just fine.
                                Actually mastodon does fine with long emojos now too

                                julian@community.nodebb.orgJ 1 Reply Last reply
                                0
                                • liaizon@social.wake.stL [email protected]

                                  @silverpill @julian @hongminhee you have listed "Image is a square" but is definitely not true for Misskey. And Mastodon renders Misskeys long emojos just fine.
                                  Actually mastodon does fine with long emojos now too

                                  julian@community.nodebb.orgJ This user is from outside of this forum
                                  julian@community.nodebb.orgJ This user is from outside of this forum
                                  [email protected]
                                  wrote last edited by
                                  #16

                                  @[email protected] oh fun, NodeBB handles the long emoji fine as well.

                                  I can't wait for this to be abused 🤣

                                  1 Reply Last reply
                                  0
                                  Reply
                                  • Reply as topic
                                  Log in to reply
                                  • Oldest to Newest
                                  • Newest to Oldest
                                  • Most Votes


                                  • Login

                                  • Don't have an account? Register

                                  • Login or register to search.
                                  Powered by NodeBB Contributors
                                  • First post
                                    Last post
                                  0
                                  • Categories
                                  • Recent
                                  • Tags
                                  • Popular
                                  • Users
                                  • Groups