Comments on: I do believe I have been bitten by Python

By: Patrik

Patrik — Sat, 20 Jun 2009 22:55:12 +0000

First of all, welcome
enca seemed very promising, but unfortunately didn’t support Swedish, at least not on my setup (which is a pity, this software would have been awesome). Will have to look into this a bit more before writing it off, since I would like to have that functionality.
recode, according to the man page does have some pretty interesting features (especially the flag –diacritics)
All in all very solid tips, thank you

By: Sergejs Pisarenko

Sergejs Pisarenko — Sat, 20 Jun 2009 22:39:01 +0000

Also, have a look at a tool called “enca” (detects file encoding) and a tool called “recode” (which changes file encoding).

The later is used by issuing something like “recode WINDOWS-1251..UTF-8 filename”.

iconv is also a good candidate for the purpose: “iconv -f WINDOWS-1251 -t UTF-8 filename > new_filename” (which you use in your script anyway).