next »

[Bompa]

I really did spend some time looking for a good board for this, but this is the
best I could find.  My issue has to do with the way websites in foreign languages
are handled by Windows OS after scraping.

My code attempts to join a site and the website returns an error in Polish,
or whatever.  In the html, the Polish characters are intact, but when my
code saves that same html source to a file on my hd, the characters are
gibberish; no longer Polish.

Here is an example in Russian:

Символы, набираемые Вами, не совпадают с символами на изображении

Translates to: "Characters that you type does not match the characters in the image"

Characters in firefox html source are the same, so that's nice, but in my saved file on my
hd, it is: Ошибка!

How can my perl code detect what the error is if it does not save the right characters?

Do I need to install a dozen different character sets on Windows?

And even if I do that, how do I know that will display correctly in my editor (UltraEdit)?

Bompa

[Phaëton]

popcorn.gif

[nutballs]

the page you are hitting "should" have a header that informs of the codepage that is being used.
if not then they are "assuming" only correct language folks who have a default codepage set which would match, ie, polish peeps hitting a polish site.