Master programming syntax, solve interactive challenges & run live code in Syntaxis Explore Arena →

menu_book Course Curriculum (Character Encoding & Unicode) expand_more

Unicode Foundations

Code points and scalar values UTF-8 byte sequences UTF-16 surrogate pairs Grapheme clusters Combining marks Normalization NFC Normalization NFD Replacement character U+FFFD

HTML & Web Encoding

HTML meta charset HTTP Content-Type charset URL percent-encoding Form URL encoding JSON Unicode escapes JavaScript Unicode escapes HTML character references Base64 versus text encoding

Strings & Storage

UTF-8 file reading Byte length versus character length Safe string slicing Case folding Locale-sensitive casing Emoji sequences Zero-width joiner BOM handling

Validation & Debugging

Detecting mojibake Invalid UTF-8 handling Round-trip encoding Database utf8mb4 Collation versus encoding Unicode-aware regex Normalization before comparison Security confusables

Character Encoding & Unicode / Strings & Storage

BOM handling

Learn BOM handling in Character Encoding & Unicode with a focused explanation, a topic-specific example, and a mastery check.

12 min read • Intermediate

encoding-024.txt

text

raw=b'\xef\xbb\xbfheader'
print(raw.decode('utf-8-sig'))

What to watch

Content source & attribution

Original Syntaxis Content · Original Syntaxis Content

Lesson quizzes

BOM handling Mastery Check →

Zero-width joiner

Detecting mojibake