RC1: Unable to read files with accents in names on Windows

[Enrico Forestieri]

On Tue, Jan 23, 2024 at 02:58:37PM -0500, Richard Kimberly Heck wrote:
> 
>On 1/23/24 14:51, Enrico Forestieri wrote:
>>On Mon, Jan 22, 2024 at 06:21:42PM -0500, Richard Kimberly Heck wrote:
>>>
>>>The conversion script has:
>>>
>>>infile = "C:/Users/Thibaut/Desktop/p k .pdf"
>>>
>>>when the input file was: ~\Desktop\píkà.pdf. The accented 
>>>characters have been stripped. This is not a surprise, though, 
>>>since toFilesystemEncoding has a comment that says it does not 
>>>work with non-ASCII characters on Windows. The puzzle is why this 
>>>worked on 2.3.7. None of this code has changed, so far as I can 
>>>see.
>>
>>Note that this might be a red herring. toFilesystemEncoding only 
>>encodes file names and not the content of a file that is utf8. The 
>>fact that the accented characters seem to have disappeared may 
>>simply be due to the fact the terminal on Windows is not able to 
>>display utf8 characters.
>>
>>So, the output should be redirected to a file to be sure.
>
>Can you explain to Didier how to do that on Windows?

This may be impossible because the distributed version of lyx is a gui 
application and prints nothing to the terminal.

>Thibaut said he could reproduce. I'm reattaching his test files and 
>logs. The logs were copied from the Messages pane, he said.

Yes, I get the same mangled name in the message pane:

infile = "C:/work/test/p�k�.pdf"

but everything works fine for me. Seemingly, the problem with the 
message pane is peculiar to the Windows native version because on cygwin 
I instead correctly get:

infile = "/c/work/test/píkà.pdf"

However, I don't know why that is so.

-- 
Enrico