en-SG - Singlish Preference test, Previous 202512017 model vs Latest 20260108

Evaluation of en-SG/Singlish model improvement from December 2025 to January 2026

Translate to English

Overall

New 2026 (Model B)

-0.38

Previous 2025 (Model A)

Answers

2. Previous 2025 (Model A) is better

-1

-2. New 2026 (Model B) is better

94 (12.05%)

136 (17.44%)

128 (16.41%)

225 (28.85%)

197 (25.26%)

Deep analysis

2. Previous 2025 (Model A) is better

-1

-2. New 2026 (Model B) is better

		Statistics
00:00 --:-- mrbrown_infer-19.wav 00:00 --:-- mrbrown_infer-19.wav 00:00 --:-- mrbrown_infer-19.wav	Previous 2025 New 2026 Reference Voices	-2.00 0.00 0.00
00:00 --:-- mrbrown_infer-12.wav 00:00 --:-- mrbrown_infer-12.wav 00:00 --:-- mrbrown_infer-12.wav	Previous 2025 New 2026 Reference Voices	0.50 0.97 0.43
00:00 --:-- mrbrown_infer-05.wav 00:00 --:-- mrbrown_infer-05.wav 00:00 --:-- mrbrown_infer-05.wav	Previous 2025 New 2026 Reference Voices	-0.30 0.59 0.26
00:00 --:-- mrbrown_infer-43.wav 00:00 --:-- mrbrown_infer-43.wav 00:00 --:-- mrbrown_infer-43.wav	Previous 2025 New 2026 Reference Voices	0.00 0.83 0.37
00:00 --:-- mrbrown_infer-31.wav 00:00 --:-- mrbrown_infer-31.wav 00:00 --:-- mrbrown_infer-31.wav	Previous 2025 New 2026 Reference Voices	-0.40 0.84 0.37
00:00 --:-- mrbrown_infer-00.wav 00:00 --:-- mrbrown_infer-00.wav 00:00 --:-- mrbrown_infer-00.wav	Previous 2025 New 2026 Reference Voices	-1.80 0.30 0.13
00:00 --:-- mrbrown_infer-32.wav 00:00 --:-- mrbrown_infer-32.wav 00:00 --:-- mrbrown_infer-32.wav	Previous 2025 New 2026 Reference Voices	-0.20 0.56 0.25
00:00 --:-- mrbrown_infer-08.wav 00:00 --:-- mrbrown_infer-08.wav 00:00 --:-- mrbrown_infer-08.wav	Previous 2025 New 2026 Reference Voices	-1.60 0.37 0.16

Overall

New 2026 (Model B)

-0.38

Previous 2025 (Model A)

Answers

2. Previous 2025 (Model A) is better

-1

-2. New 2026 (Model B) is better

94 (12.05%)

136 (17.44%)

128 (16.41%)

225 (28.85%)

197 (25.26%)

Deep analysis

2. Previous 2025 (Model A) is better

-1

-2. New 2026 (Model B) is better

		Statistics
00:00 --:-- mrbrown_infer-19.wav 00:00 --:-- mrbrown_infer-19.wav 00:00 --:-- mrbrown_infer-19.wav	Previous 2025 New 2026 Reference Voices	-2.00 0.00 0.00
00:00 --:-- mrbrown_infer-12.wav 00:00 --:-- mrbrown_infer-12.wav 00:00 --:-- mrbrown_infer-12.wav	Previous 2025 New 2026 Reference Voices	0.50 0.97 0.43
00:00 --:-- mrbrown_infer-05.wav 00:00 --:-- mrbrown_infer-05.wav 00:00 --:-- mrbrown_infer-05.wav	Previous 2025 New 2026 Reference Voices	-0.30 0.59 0.26
00:00 --:-- mrbrown_infer-43.wav 00:00 --:-- mrbrown_infer-43.wav 00:00 --:-- mrbrown_infer-43.wav	Previous 2025 New 2026 Reference Voices	0.00 0.83 0.37
00:00 --:-- mrbrown_infer-31.wav 00:00 --:-- mrbrown_infer-31.wav 00:00 --:-- mrbrown_infer-31.wav	Previous 2025 New 2026 Reference Voices	-0.40 0.84 0.37
00:00 --:-- mrbrown_infer-00.wav 00:00 --:-- mrbrown_infer-00.wav 00:00 --:-- mrbrown_infer-00.wav	Previous 2025 New 2026 Reference Voices	-1.80 0.30 0.13
00:00 --:-- mrbrown_infer-32.wav 00:00 --:-- mrbrown_infer-32.wav 00:00 --:-- mrbrown_infer-32.wav	Previous 2025 New 2026 Reference Voices	-0.20 0.56 0.25
00:00 --:-- mrbrown_infer-08.wav 00:00 --:-- mrbrown_infer-08.wav 00:00 --:-- mrbrown_infer-08.wav	Previous 2025 New 2026 Reference Voices	-1.60 0.37 0.16