Emoji TTF font setting not working #199

noraj · 2023-02-05T22:40:23Z

Describe the bug

Emoji TTF font setting not working.

To Reproduce

Whatever the TTF font I use from the env. var. or with the option, emojis are not displayed.

# set emoji font in env var
export TEXTIMG_EMOJI_FONT_FILE=/usr/share/fonts/noto/NotoColorEmoji.ttf
export TEXTIMG_EMOJI_FONT_FILE=/usr/share/fonts/joypixels/JoyPixels.ttf
# from env var
echo あ😃a👍！👀ん👄 | ./textimg -i -o emoji.png
# explicit option
echo あ😃a👍！👀ん👄 | ./textimg -i -e /usr/share/fonts/joypixels/JoyPixels.ttf -o emoji.png

Output image:

Expected behavior

Emoji displayed as in the documentation https://github.com/jiro4989/textimg#emoji-font-ttf.

Environment (please complete the following information)

OS: ArchLinux
Version: textimg 3.1.7

noraj · 2023-02-05T22:47:25Z

Emoji image variant works however.

git clone https://github.com/googlefonts/noto-emoji /tmp/noto-emoji
export TEXTIMG_EMOJI_DIR=/tmp/noto-emoji/png/128
echo あ😃a👍！👀ん👄 | ./textimg -o emoji.png

jiro4989 · 2023-02-08T00:24:42Z

I don't have an Arch Linux environment, so I can't test it. Solve the problem yourself.

Probably, I think that the JoyPixels font does not support Japanese.

/usr/share/fonts/joypixels/JoyPixels.ttf

jiro4989 · 2023-02-08T00:27:31Z

You can draw Japanese with these fonts.

textimg/config/config.go

Lines 62 to 69 in 80e940a

    
           const ( 
        
           	defaultWindowsFont = `C:\Windows\Fonts\msgothic.ttc` 
        
           	defaultDarwinFont  = "/System/Library/Fonts/AppleSDGothicNeo.ttc" 
        
           	defaultIOSFont     = "/System/Library/Fonts/Core/AppleSDGothicNeo.ttc" 
        
           	defaultAndroidFont = "/system/fonts/NotoSansCJK-Regular.ttc" 
        
           	defaultLinuxFont1  = "/usr/share/fonts/opentype/noto/NotoSansCJK-Regular.ttc" 
        
           	defaultLinuxFont2  = "/usr/share/fonts/noto-cjk/NotoSansCJK-Regular.ttc" 
        
           )

noraj · 2023-02-08T22:17:17Z

I don't have an Arch Linux environment, so I can't test it. Solve the problem yourself.

I don't think it's related to the OS flavor.

Probably, I think that the JoyPixels font does not support Japanese.

Japanese character not displayed is expected but the emoji should be.

jiro4989 · 2023-02-08T22:39:05Z

If you want to draw Japanese, set TEXTIMG_FONT_FILE to a font that supports Japanese.
TEXTIMG_FONT_FILE is used for drawing non-emoticons.

See: https://github.com/jiro4989/textimg#fonts

I don't think it's related to the OS flavor.

I don't know ArchLinux's font folder. I don't even know what fonts will be installed.

noraj · 2023-02-11T15:11:43Z

It's not about Japanese chars or ArchLinux. It's a bug in textimg where emoji font option is ignored!

$ wget https://github.com/jiro4989/textimg/releases/download/v3.1.8/textimg-linux-amd64.tar.gz
$ tar xaf textimg-linux-amd64.tar.gz
$ ls /usr/share/fonts/noto/NotoColorEmoji.ttf
/usr/share/fonts/noto/NotoColorEmoji.ttf
$ export TEXTIMG_EMOJI_FONT_FILE=/usr/share/fonts/noto/NotoColorEmoji.ttf
# from env var
$ echo 😃👍👀👄 | ./textimg -i -o emoji.png
2023/02/11 04:07:42 textimg [WARN] /home/runner/work/textimg/textimg/config/face.go:42 /usr/share/fonts/noto-cjk/NotoSansCJK-Regular.ttc is not found. please set font path with `-f` option

# explicit option
$ echo 😃👍👀👄 | ./textimg -i -e /usr/share/fonts/joypixels/JoyPixels.ttf -o emoji.png       
2023/02/11 04:09:38 textimg [WARN] /home/runner/work/textimg/textimg/config/face.go:42 /usr/share/fonts/noto-cjk/NotoSansCJK-Regular.ttc is not found. please set font path with `-f` option

jiro4989 · 2023-02-11T17:33:00Z

See WARN message.

2023/02/11 04:07:42 textimg [WARN] /home/runner/work/textimg/textimg/config/face.go:42 /usr/share/fonts/noto-cjk/NotoSansCJK-Regular.ttc is not found. please set font path with -f option

jiro4989 · 2023-02-11T17:45:49Z

This is what happens when I run

$ textimg あいうえお😀 -f /usr/share/fonts/opentype/noto/NotoSansCJK-Regular.ttc -o /images/z.png

$ export TEXTIMG_FONT_FILE='/usr/share/fonts/opentype/noto/NotoSansCJK-Regular.ttc'
$ textimg あいうえお😀 -o /images/z.png

export TEXTIMG_EMOJI_FONT_FILE=/usr/share/fonts/truetype/noto/NotoColorEmoji.ttf
export TEXTIMG_FONT_FILE='/usr/share/fonts/opentype/noto/NotoSansCJK-Regular.ttc'
textimg あいうえお😀 -o /images/z.png

$ textimg あいうえお -f zzz.ttf -o /images/z.png
2023/02/11 05:43:36 textimg [WARN] /root/go/pkg/mod/github.com/jiro4989/textimg/v3@v3.1.8/config/face.go:42 zzz.ttf is not found. please set font path with `-f` option

jiro4989 · 2023-02-11T17:50:58Z

textimg uses two fonts to draw characters.

TEXTIMG_FONT_FILE
TEXTIMG_EMOJI_FONT_FILE

In your environment, the font specified by default in TEXTIMG_FONT_FILE does not exist, so Japanese cannot be drawn.

jiro4989 · 2023-02-11T17:54:12Z

The default font used by textimg is based on the path installed in Ubuntu.

#199 (comment)

Rendering Japanese has failed because a font (TEXTIMG_FONT_FILE) that does not exist in your environment is used.

jiro4989 · 2023-02-11T17:58:08Z

textimg doesn't support every font path on every OS.
Set a font that can draw Japanese in TEXTIMG_FONT_FILE.

jiro4989 · 2023-02-11T18:07:52Z

No, no. I didn't understand the issues.

jiro4989 · 2023-02-11T18:15:58Z

I finally understand. Indeed, TEXTIMG_EMOJI_FONT_FILE is not working as you said.

textimg あいうえお😀 -o /images/a.png
export TEXTIMG_EMOJI_FONT_FILE='sushi.ttf'
textimg あいうえお😀 -o /images/b.png

2023/02/11 06:15:30 textimg [WARN] /root/go/pkg/mod/github.com/jiro4989/textimg/v3@v3.1.8/config/face.go:42 sushi.ttf is not found. please set font path with -f option

a.png:

b.png:

It has the wrong warning message and the wrong font priority.
This is a textimg bug.

jiro4989 · 2023-02-11T18:23:06Z

Please forgive me for my untruthful reading of the issues.🙇
I will investigate the cause of the bug.

jiro4989 · 2023-02-11T19:02:45Z

hmm? The -e option is working.

textimg -e /usr/share/fonts/truetype/noto/NotoColorEmoji.ttf あいうえお😀 -io /images/a.png
textimg -e /usr/share/fonts/truetype/ancient-scripts/Symbola_hint.ttf あいうえお😀 -io /images/b.png

a.png:

b.png:

textimg -e a.ttf あいうえお😀 -io /images/c.png

2023/02/11 07:02:23 textimg [WARN] /root/go/pkg/mod/github.com/jiro4989/textimg/v3@v3.1.8/config/face.go:42 a.ttf is not found. please set font path with -f option

jiro4989 · 2023-02-11T19:16:02Z

It may be a font reading TTF, TTC or rendering problem. Please give me a few days.

jiro4989 · 2023-02-14T21:34:10Z

hmm...

Alphabet is OK
Emoji is NG

package main

import (
	"fmt"
	"strings"
)

func main() {
	// alphabet
	const startAlphabetCodePoint rune = 'A'
	const endAlphabetCodePoint rune = 'z'
	var sb strings.Builder
	appendRangeStrings(&sb, startAlphabetCodePoint, endAlphabetCodePoint)

	// emoji
	const startEmojiCodePoint rune = 0x1f600
	const endEmojiCodePoint = startEmojiCodePoint + 1000
	appendRangeStrings(&sb, startEmojiCodePoint, endEmojiCodePoint)
	fmt.Println(sb.String())
}

func appendRangeStrings(sb *strings.Builder, s, e rune) {
	counter := 1
	for i := s; i <= e; i++ {
		r := []rune{i}
		s := string(r)
		sb.WriteString(s)
		if counter%50 == 0 {
			sb.WriteString("\n")
		}
		counter++
	}
	sb.WriteString("\n")
}

$ go run main.go
ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqr
stuvwxyz
😀😁😂😃😄😅😆😇😈😉😊😋😌😍😎😏😐😑😒😓😔😕😖😗😘😙😚😛😜😝😞😟😠😡😢😣😤😥😦😧😨😩😪😫😬😭😮😯😰😱
😲😳😴😵😶😷😸😹😺😻😼😽😾😿🙀🙁🙂🙃🙄🙅🙆🙇🙈🙉🙊🙋🙌🙍🙎🙏🙐🙑🙒🙓🙔🙕🙖🙗🙘🙙🙚🙛🙜🙝🙞🙟🙠🙡🙢🙣
🙤🙥🙦🙧🙨🙩🙪🙫🙬🙭🙮🙯🙰🙱🙲🙳🙴🙵🙶🙷🙸🙹🙺🙻🙼🙽🙾🙿🚀🚁🚂🚃🚄🚅🚆🚇🚈🚉🚊🚋🚌🚍🚎🚏🚐🚑🚒🚓🚔🚕
🚖🚗🚘🚙🚚🚛🚜🚝🚞🚟🚠🚡🚢🚣🚤🚥🚦🚧🚨🚩🚪🚫🚬🚭🚮🚯🚰🚱🚲🚳🚴🚵🚶🚷🚸🚹🚺🚻🚼🚽🚾🚿🛀🛁🛂🛃🛄🛅🛆🛇
🛈🛉🛊🛋🛌🛍🛎🛏🛐🛑🛒🛓🛔🛕🛖🛗🛘🛙🛚🛛🛜🛝🛞🛟🛠🛡🛢🛣🛤🛥🛦🛧🛨🛩🛪🛫🛬🛭🛮🛯🛰🛱🛲🛳🛴🛵🛶🛷🛸🛹
🛺🛻🛼🛽🛾🛿🜀🜁🜂🜃🜄🜅🜆🜇🜈🜉🜊🜋🜌🜍🜎🜏🜐🜑🜒🜓🜔🜕🜖🜗🜘🜙🜚🜛🜜🜝🜞🜟🜠🜡🜢🜣🜤🜥🜦🜧🜨🜩🜪🜫
🜬🜭🜮🜯🜰🜱🜲🜳🜴🜵🜶🜷🜸🜹🜺🜻🜼🜽🜾🜿🝀🝁🝂🝃🝄🝅🝆🝇🝈🝉🝊🝋🝌🝍🝎🝏🝐🝑🝒🝓🝔🝕🝖🝗🝘🝙🝚🝛🝜🝝
🝞🝟🝠🝡🝢🝣🝤🝥🝦🝧🝨🝩🝪🝫🝬🝭🝮🝯🝰🝱🝲🝳🝴🝵🝶🝷🝸🝹🝺🝻🝼🝽🝾🝿🞀🞁🞂🞃🞄🞅🞆🞇🞈🞉🞊🞋🞌🞍🞎🞏
🞐🞑🞒🞓🞔🞕🞖🞗🞘🞙🞚🞛🞜🞝🞞🞟🞠🞡🞢🞣🞤🞥🞦🞧🞨🞩🞪🞫🞬🞭🞮🞯🞰🞱🞲🞳🞴🞵🞶🞷🞸🞹🞺🞻🞼🞽🞾🞿🟀🟁
🟂🟃🟄🟅🟆🟇🟈🟉🟊🟋🟌🟍🟎🟏🟐🟑🟒🟓🟔🟕🟖🟗🟘🟙🟚🟛🟜🟝🟞🟟🟠🟡🟢🟣🟤🟥🟦🟧🟨🟩🟪🟫🟬🟭🟮🟯🟰🟱🟲🟳
🟴🟵🟶🟷🟸🟹🟺🟻🟼🟽🟾🟿🠀🠁🠂🠃🠄🠅🠆🠇🠈🠉🠊🠋🠌🠍🠎🠏🠐🠑🠒🠓🠔🠕🠖🠗🠘🠙🠚🠛🠜🠝🠞🠟🠠🠡🠢🠣🠤🠥
🠦🠧🠨🠩🠪🠫🠬🠭🠮🠯🠰🠱🠲🠳🠴🠵🠶🠷🠸🠹🠺🠻🠼🠽🠾🠿🡀🡁🡂🡃🡄🡅🡆🡇🡈🡉🡊🡋🡌🡍🡎🡏🡐🡑🡒🡓🡔🡕🡖🡗
🡘🡙🡚🡛🡜🡝🡞🡟🡠🡡🡢🡣🡤🡥🡦🡧🡨🡩🡪🡫🡬🡭🡮🡯🡰🡱🡲🡳🡴🡵🡶🡷🡸🡹🡺🡻🡼🡽🡾🡿🢀🢁🢂🢃🢄🢅🢆🢇🢈🢉
🢊🢋🢌🢍🢎🢏🢐🢑🢒🢓🢔🢕🢖🢗🢘🢙🢚🢛🢜🢝🢞🢟🢠🢡🢢🢣🢤🢥🢦🢧🢨🢩🢪🢫🢬🢭🢮🢯🢰🢱🢲🢳🢴🢵🢶🢷🢸🢹🢺🢻
🢼🢽🢾🢿🣀🣁🣂🣃🣄🣅🣆🣇🣈🣉🣊🣋🣌🣍🣎🣏🣐🣑🣒🣓🣔🣕🣖🣗🣘🣙🣚🣛🣜🣝🣞🣟🣠🣡🣢🣣🣤🣥🣦🣧🣨🣩🣪🣫🣬🣭
🣮🣯🣰🣱🣲🣳🣴🣵🣶🣷🣸🣹🣺🣻🣼🣽🣾🣿🤀🤁🤂🤃🤄🤅🤆🤇🤈🤉🤊🤋🤌🤍🤎🤏🤐🤑🤒🤓🤔🤕🤖🤗🤘🤙🤚🤛🤜🤝🤞🤟
🤠🤡🤢🤣🤤🤥🤦🤧🤨🤩🤪🤫🤬🤭🤮🤯🤰🤱🤲🤳🤴🤵🤶🤷🤸🤹🤺🤻🤼🤽🤾🤿🥀🥁🥂🥃🥄🥅🥆🥇🥈🥉🥊🥋🥌🥍🥎🥏🥐🥑
🥒🥓🥔🥕🥖🥗🥘🥙🥚🥛🥜🥝🥞🥟🥠🥡🥢🥣🥤🥥🥦🥧🥨🥩🥪🥫🥬🥭🥮🥯🥰🥱🥲🥳🥴🥵🥶🥷🥸🥹🥺🥻🥼🥽🥾🥿🦀🦁🦂🦃
🦄🦅🦆🦇🦈🦉🦊🦋🦌🦍🦎🦏🦐🦑🦒🦓🦔🦕🦖🦗🦘🦙🦚🦛🦜🦝🦞🦟🦠🦡🦢🦣🦤🦥🦦🦧🦨🦩🦪🦫🦬🦭🦮🦯🦰🦱🦲🦳🦴🦵
🦶🦷🦸🦹🦺🦻🦼🦽🦾🦿🧀🧁🧂🧃🧄🧅🧆🧇🧈🧉🧊🧋🧌🧍🧎🧏🧐🧑🧒🧓🧔🧕🧖🧗🧘🧙🧚🧛🧜🧝🧞🧟🧠🧡🧢🧣🧤🧥🧦🧧
🧨

$ go run main.go | textimg -i -e /usr/share/fonts/truetype/noto/NotoColorEmoji.ttf -o ~/Downloads/emoji.png

Result:

Emoji using TTF files cannot be drawn.

jiro4989 · 2023-02-14T21:47:49Z

I can see why this would work.
#199 (comment)

textimg reads the image of emoji codepoint of filename when you set TEXTIMG_EMOJI_DIR.

textimg/image/util.go

Line 32 in 210ddc5

path := fmt.Sprintf("%s/emoji_u%.4x.png", emojiDir, r)

And writes image pixels to output.

But, textimg use the ttf file when you set TEXTIMG_EMOJI_FONT_FILE.
So, the rendering logic is different.
It's probably a bug in the implementation that uses TEXTIMG_EMOJI_FONT_FILE.

jiro4989 · 2023-02-20T09:42:13Z

@noraj This seems to be an issue with the golang/freetype library.
golang/freetype#45 (comment)

When I first implemented textimg, I couldn't draw color emoji, so I implemented it using emoji image files.
(I just remembered. 😅)

And since this issue is still unresolved, textimg cannot support color emoji TTF either. 😓

noraj · 2023-02-20T12:00:34Z

Yeah last comment there is 6 years ago and they are talking about unicode v3/4 while we are at Unicode 15 now. This library will not support emoji anytime soon if ever. So either i will stay that way or maybe anoter more modern lib can be used.

jiro4989 · 2023-02-26T22:49:53Z

I searched for an alternative library, but it's probably not in Go language.
So this problem can't be solved.

noraj · 2023-02-26T23:07:18Z

Sad news.

noraj added the bug Something isn't working label Feb 5, 2023

noraj assigned jiro4989 Feb 5, 2023

noraj changed the title ~~Emoji font setting not working~~ Emoji TTF font setting not working Feb 5, 2023

jiro4989 closed this as completed Feb 8, 2023

jiro4989 reopened this Feb 8, 2023

jiro4989 closed this as completed Feb 11, 2023

jiro4989 reopened this Feb 11, 2023

jiro4989 mentioned this issue Feb 11, 2023

警告メッセージが間違っている #201

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Emoji TTF font setting not working #199

Emoji TTF font setting not working #199

noraj commented Feb 5, 2023 •

edited

Loading

noraj commented Feb 5, 2023

jiro4989 commented Feb 8, 2023

jiro4989 commented Feb 8, 2023 •

edited

Loading

noraj commented Feb 8, 2023

jiro4989 commented Feb 8, 2023 •

edited

Loading

noraj commented Feb 11, 2023

jiro4989 commented Feb 11, 2023

jiro4989 commented Feb 11, 2023 •

edited

Loading

jiro4989 commented Feb 11, 2023

jiro4989 commented Feb 11, 2023 •

edited

Loading

jiro4989 commented Feb 11, 2023 •

edited

Loading

jiro4989 commented Feb 11, 2023

jiro4989 commented Feb 11, 2023 •

edited

Loading

jiro4989 commented Feb 11, 2023

jiro4989 commented Feb 11, 2023

jiro4989 commented Feb 11, 2023 •

edited

Loading

jiro4989 commented Feb 14, 2023

jiro4989 commented Feb 14, 2023

jiro4989 commented Feb 20, 2023

noraj commented Feb 20, 2023

jiro4989 commented Feb 26, 2023 •

edited

Loading

noraj commented Feb 26, 2023

Emoji TTF font setting not working #199

Emoji TTF font setting not working #199

Comments

noraj commented Feb 5, 2023 • edited Loading

Describe the bug

To Reproduce

Expected behavior

Environment (please complete the following information)

noraj commented Feb 5, 2023

jiro4989 commented Feb 8, 2023

jiro4989 commented Feb 8, 2023 • edited Loading

noraj commented Feb 8, 2023

jiro4989 commented Feb 8, 2023 • edited Loading

noraj commented Feb 11, 2023

jiro4989 commented Feb 11, 2023

jiro4989 commented Feb 11, 2023 • edited Loading

jiro4989 commented Feb 11, 2023

jiro4989 commented Feb 11, 2023 • edited Loading

jiro4989 commented Feb 11, 2023 • edited Loading

jiro4989 commented Feb 11, 2023

jiro4989 commented Feb 11, 2023 • edited Loading

jiro4989 commented Feb 11, 2023

jiro4989 commented Feb 11, 2023

jiro4989 commented Feb 11, 2023 • edited Loading

jiro4989 commented Feb 14, 2023

jiro4989 commented Feb 14, 2023

jiro4989 commented Feb 20, 2023

noraj commented Feb 20, 2023

jiro4989 commented Feb 26, 2023 • edited Loading

noraj commented Feb 26, 2023

noraj commented Feb 5, 2023 •

edited

Loading

jiro4989 commented Feb 8, 2023 •

edited

Loading

jiro4989 commented Feb 8, 2023 •

edited

Loading

jiro4989 commented Feb 11, 2023 •

edited

Loading

jiro4989 commented Feb 11, 2023 •

edited

Loading

jiro4989 commented Feb 11, 2023 •

edited

Loading

jiro4989 commented Feb 11, 2023 •

edited

Loading

jiro4989 commented Feb 11, 2023 •

edited

Loading

jiro4989 commented Feb 26, 2023 •

edited

Loading