View Issue Details

IDProjectCategoryView StatusLast Update
0000910luatexluatex limitationpublic2015-09-11 22:08
Reporterkarlberry Assigned ToHans Hagen  
PrioritynormalSeverityminorReproducibilityalways
Status closedResolutionfixed 
Product Version0.74.0 
Summary0000910: 8-bit chars on cmdline
DescriptionKlaus Ethgen <Klaus@Ethgen.ch> reported a bug about using Latin-1 file names on the command on the tex-live list, starting here: http://tug.org/pipermail/tex-live/2014-July/035646.html The thread wandered off into pointlessness, as threads do, don't bother reading it.

Given that TeX has always more or less treated the command line as a first line of input, and given that TeX has never paid attention to the environment's locale settings to interpret input (a good&necessary thing IMHO), the result is not surprising to me.

So maybe what is needed is documentation on how to put luatex into 8-bit mode before interpreting filenames. Or restore the --8bit option to functionality.
TagsNo tags attached.

Activities

Hans Hagen

2014-07-17 20:15

manager   ~0001275

This is a can of worms we're not going to open. Luatex is utf. One can easily hook in file readers that deal with any encoding. The 'pass something on commandline' is imo obsolete (apart from trivial ascii).

Users who stay in 8-bit heaven can best use pdftex.

Technically luatex is 8 bit clean wrt the filenames but at some point they might enter tex itself (like typesetting jobname) in which case it has to be utf. We had discussions like this a while ago about windows (can be whatever os) and code pages, cut and paste in file browsers and other tools, and anyone who runs into this kind of stuff has to realize that it can go wrong any place ...

(there had been patches in the past that worked well for locates but then broke down everything else by opening other cans of worms .. e.g. windows started using unicode 16 before there was utf so we're stuck with that too)

(fwiw: in context i explicitly turn of locales in lua)

We could indeed make these things more explicit in the manual.
 
Hans

Issue History

Date Modified Username Field Change
2014-07-17 18:13 karlberry New Issue
2014-07-17 20:15 Hans Hagen Note Added: 0001275
2015-03-21 15:13 Hans Hagen Assigned To => Hans Hagen
2015-03-21 15:13 Hans Hagen Status new => assigned
2015-09-11 22:08 Hans Hagen Status assigned => closed
2015-09-11 22:08 Hans Hagen Resolution open => fixed