Browse Source

treat any file with NUL as binary

There are two heuristics in Git to detect whether a file is binary
or text. One in xdiff-interface.c (which is taken from GNU diff)
relies on existence of the NUL byte at the beginning. However,
convert.c used a different heuristic, which relied on the percent
of non-printable symbols (less than 1% for text files).

Due to differences in detection whether a file is binary or not,
it was possible that a file that diff treats as binary could be
treated as text by CRLF conversion. This is very confusing for a
user who sees that 'git diff' shows the file as binary expects it
to be added as binary.

This patch makes is_binary to consider any file that contains at
least one NUL character as binary, to ensure that the heuristics
used for CRLF conversion is tighter than what is used by diff.

Signed-off-by: Dmitry Potapov <dpotapov@gmail.com>
Signed-off-by: Junio C Hamano <gitster@pobox.com>
maint
Dmitry Potapov 17 years ago committed by Junio C Hamano
parent
commit
28624193b2
  1. 9
      convert.c

9
convert.c

@ -17,8 +17,8 @@
#define CRLF_INPUT 2 #define CRLF_INPUT 2


struct text_stat { struct text_stat {
/* CR, LF and CRLF counts */ /* NUL, CR, LF and CRLF counts */
unsigned cr, lf, crlf; unsigned nul, cr, lf, crlf;


/* These are just approximations! */ /* These are just approximations! */
unsigned printable, nonprintable; unsigned printable, nonprintable;
@ -51,6 +51,9 @@ static void gather_stats(const char *buf, unsigned long size, struct text_stat *
case '\b': case '\t': case '\033': case '\014': case '\b': case '\t': case '\033': case '\014':
stats->printable++; stats->printable++;
break; break;
case 0:
stats->nul++;
/* fall through */
default: default:
stats->nonprintable++; stats->nonprintable++;
} }
@ -66,6 +69,8 @@ static void gather_stats(const char *buf, unsigned long size, struct text_stat *
static int is_binary(unsigned long size, struct text_stat *stats) static int is_binary(unsigned long size, struct text_stat *stats)
{ {


if (stats->nul)
return 1;
if ((stats->printable >> 7) < stats->nonprintable) if ((stats->printable >> 7) < stats->nonprintable)
return 1; return 1;
/* /*

Loading…
Cancel
Save