Master programming syntax, solve interactive challenges & run live code in Syntaxis Explore Arena →

menu_book Course Curriculum (Character Encoding & Unicode) expand_more

Unicode Foundations

Code points and scalar values UTF-8 byte sequences UTF-16 surrogate pairs Grapheme clusters Combining marks Normalization NFC Normalization NFD Replacement character U+FFFD

HTML & Web Encoding

HTML meta charset HTTP Content-Type charset URL percent-encoding Form URL encoding JSON Unicode escapes JavaScript Unicode escapes HTML character references Base64 versus text encoding

Strings & Storage

UTF-8 file reading Byte length versus character length Safe string slicing Case folding Locale-sensitive casing Emoji sequences Zero-width joiner BOM handling

Validation & Debugging

Detecting mojibake Invalid UTF-8 handling Round-trip encoding Database utf8mb4 Collation versus encoding Unicode-aware regex Normalization before comparison Security confusables

Character Encoding & Unicode / Validation & Debugging

Detecting mojibake

Learn Detecting mojibake in Character Encoding & Unicode with a focused explanation, a topic-specific example, and a mastery check.

12 min read • Intermediate

encoding-025.txt

text

bad='cafÃ©'
fixed=bad.encode('latin1').decode('utf-8')
print(fixed)

What to watch

Content source & attribution

Original Syntaxis Content · Original Syntaxis Content

Lesson quizzes

Detecting mojibake Mastery Check →

Invalid UTF-8 handling