Go to file
Nguyễn Thái Ngọc Duy ac77d0c370 pack-objects: shrink size field in struct object_entry
It's very very rare that an uncompressed object is larger than 4GB
(partly because Git does not handle those large files very well to
begin with). Let's optimize it for the common case where object size
is smaller than this limit.

Shrink size field down to 31 bits and one overflow bit. If the size is
too large, we read it back from disk. As noted in the previous patch,
we need to return the delta size instead of canonical size when the
to-be-reused object entry type is a delta instead of a canonical one.

Add two compare helpers that can take advantage of the overflow
bit (e.g. if the file is 4GB+, chances are it's already larger than
core.bigFileThreshold and there's no point in comparing the actual
value).

Another note about oe_get_size_slow(). This function MUST be thread
safe because SIZE() macro is used inside try_delta() which may run in
parallel. Outside parallel code, no-contention locking should be dirt
cheap (or insignificant compared to i/o access anyway). To exercise
this code, it's best to run the test suite with something like

    make test GIT_TEST_OE_SIZE=4

which forces this code on all objects larger than 3 bytes.

Signed-off-by: Nguyễn Thái Ngọc Duy <pclouds@gmail.com>
Signed-off-by: Junio C Hamano <gitster@pobox.com>
2018-04-16 12:38:59 +09:00
.github
Documentation pack-objects: shrink z_delta_size field in struct object_entry 2018-04-16 12:38:58 +09:00
block-sha1
builtin pack-objects: shrink size field in struct object_entry 2018-04-16 12:38:59 +09:00
ci read-cache.c: make $GIT_TEST_SPLIT_INDEX boolean 2018-04-16 12:38:58 +09:00
compat mingw: abort on invalid strftime formats 2018-03-19 10:53:17 -07:00
contrib Merge branch 'ab/drop-contrib-examples' 2018-04-11 13:09:54 +09:00
ewah
git-gui
gitk-git
gitweb
mergetools
perl git-svn: allow empty email-address using authors-prog and authors-file 2018-04-05 19:22:06 +00:00
po l10n: de.po: translate 132 new messages 2018-03-31 13:21:09 +02:00
ppc
refs Merge branch 'mr/packed-ref-store-fix' into maint 2018-03-22 14:24:10 -07:00
sha1collisiondetection@19d97bf5af
sha1dc
t pack-objects: shrink size field in struct object_entry 2018-04-16 12:38:59 +09:00
templates
vcs-svn
xdiff
.clang-format
.gitattributes
.gitignore
.gitmodules
.mailmap
.travis.yml
.tsan-suppressions
COPYING
GIT-VERSION-GEN The first batch for 2.18 cycle 2018-04-10 08:31:17 +09:00
INSTALL RelNotes: add details on Perl module changes 2018-03-16 16:07:37 -07:00
LGPL-2.1
Makefile Merge branch 'nd/combined-test-helper' 2018-04-11 13:09:56 +09:00
README.md
RelNotes The first batch for 2.18 cycle 2018-04-10 08:31:17 +09:00
abspath.c
aclocal.m4
advice.c
advice.h
alias.c
alloc.c
apply.c Merge branch 'bc/object-id' 2018-04-10 08:25:45 +09:00
apply.h
archive-tar.c sha1_file: convert sha1_object_info* to object_id 2018-03-14 09:23:49 -07:00
archive-zip.c sha1_file: convert sha1_object_info* to object_id 2018-03-14 09:23:49 -07:00
archive.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
archive.h archive: convert sha1_file_to_archive to struct object_id 2018-03-14 09:23:48 -07:00
argv-array.c
argv-array.h
attr.c
attr.h
base85.c
bisect.c Merge branch 'ys/bisect-object-id-missing-conversion-fix' 2018-04-10 16:28:24 +09:00
bisect.h
blame.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
blame.h
blob.c
blob.h
branch.c
branch.h
builtin.h
bulk-checkin.c Merge branch 'sb/packfiles-in-repository' 2018-04-11 13:09:55 +09:00
bulk-checkin.h bulk-checkin: convert index_bulk_checkin to struct object_id 2018-03-14 09:23:47 -07:00
bundle.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
bundle.h
cache-tree.c Merge branch 'tg/split-index-fixes' into maint 2018-03-22 14:24:10 -07:00
cache-tree.h cache-tree: convert write_*_as_tree to object_id 2018-03-14 09:23:47 -07:00
cache.h pack-objects: turn type and in_pack_type to bitfields 2018-04-16 12:38:58 +09:00
check-builtins.sh
check-racy.c
check_bindir
checkout.c
checkout.h
color.c
color.h
column.c
column.h
combine-diff.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
command-list.txt
commit-slab.h
commit.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
commit.h
common-main.c
config.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
config.h
config.mak.in
config.mak.uname
configure.ac Makefile: make USE_LIBPCRE=YesPlease mean v2, not v1 2018-03-14 15:27:50 -07:00
connect.c
connect.h
connected.c
connected.h
convert.c convert: convert to struct object_id 2018-03-14 09:23:50 -07:00
convert.h convert: convert to struct object_id 2018-03-14 09:23:50 -07:00
copy.c
credential-cache--daemon.c
credential-cache.c
credential-store.c
credential.c credential: ignore SIGPIPE when writing to credential helpers 2018-03-29 15:33:55 -07:00
credential.h
csum-file.c
csum-file.h
ctype.c
daemon.c
date.c
decorate.c
decorate.h
delta.h
diff-delta.c
diff-lib.c
diff-no-index.c
diff.c Merge branch 'bc/object-id' 2018-04-10 08:25:45 +09:00
diff.h Merge branch 'nd/diff-stat-with-summary' 2018-03-14 12:01:02 -07:00
diffcore-break.c
diffcore-delta.c
diffcore-order.c
diffcore-pickaxe.c
diffcore-rename.c
diffcore.h
dir-iterator.c
dir-iterator.h
dir.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
dir.h
editor.c
entry.c convert: convert to struct object_id 2018-03-14 09:23:50 -07:00
environment.c Merge branch 'sb/object-store' 2018-04-11 13:09:55 +09:00
exec_cmd.c
exec_cmd.h
fast-import.c Merge branch 'sb/packfiles-in-repository' 2018-04-11 13:09:55 +09:00
fetch-object.c
fetch-object.h
fetch-pack.c Merge branch 'sb/packfiles-in-repository' 2018-04-11 13:09:55 +09:00
fetch-pack.h
fmt-merge-msg.h
fsck.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
fsck.h
fsmonitor.c
fsmonitor.h
generate-cmdlist.sh
gettext.c
gettext.h
git-add--interactive.perl Merge branch 'pw/add-p-single' 2018-04-02 10:10:55 -07:00
git-archimport.perl
git-bisect.sh
git-compat-util.h
git-cvsexportcommit.perl
git-cvsimport.perl
git-cvsserver.perl
git-difftool--helper.sh
git-filter-branch.sh Merge branch 'yk/filter-branch-non-committish-refs' 2018-04-10 16:28:23 +09:00
git-instaweb.sh
git-merge-octopus.sh
git-merge-one-file.sh
git-merge-resolve.sh
git-mergetool--lib.sh
git-mergetool.sh
git-p4.py
git-parse-remote.sh
git-quiltimport.sh
git-rebase--am.sh rebase: update invocation of rebase dot-sourced scripts 2018-03-23 15:08:49 -07:00
git-rebase--interactive.sh rebase: remove merges_option and a blank line 2018-03-23 15:28:24 -07:00
git-rebase--merge.sh rebase: update invocation of rebase dot-sourced scripts 2018-03-23 15:08:49 -07:00
git-rebase.sh rebase: add and use git_rebase__interactive__preserve_merges 2018-03-23 15:28:06 -07:00
git-remote-testgit.sh
git-request-pull.sh
git-send-email.perl Merge branch 'ab/perl-fixes' 2018-03-15 15:00:46 -07:00
git-sh-i18n.sh
git-sh-setup.sh
git-stash.sh Merge branch 'tg/stash-untracked-with-pathspec-fix' 2018-04-10 08:25:45 +09:00
git-submodule.sh
git-svn.perl git-svn: search --authors-prog in PATH too 2018-04-05 06:55:02 +00:00
git-web--browse.sh
git.c Merge branch 'nd/parseopt-completion-more' 2018-04-10 16:28:22 +09:00
git.rc
gpg-interface.c
gpg-interface.h
graph.c
graph.h
grep.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
grep.h
hash.h
hashmap.c
hashmap.h Merge branch 'rb/hashmap-h-compilation-fix' into maint 2018-03-22 14:24:15 -07:00
help.c
help.h
hex.c
http-backend.c packfile: keep prepare_packed_git() private 2018-03-26 10:07:43 -07:00
http-fetch.c
http-push.c Merge branch 'sb/object-store' 2018-04-11 13:09:55 +09:00
http-walker.c Merge branch 'sb/object-store' 2018-04-11 13:09:55 +09:00
http.c Merge branch 'lv/tls-1.3' 2018-04-11 13:09:57 +09:00
http.h
ident.c
imap-send.c
iterator.h
khash.h
kwset.c
kwset.h
levenshtein.c
levenshtein.h
line-log.c tree-walk: convert tree entry functions to object_id 2018-03-14 09:23:50 -07:00
line-log.h
line-range.c
line-range.h
list-objects-filter-options.c
list-objects-filter-options.h
list-objects-filter.c sha1_file: convert sha1_object_info* to object_id 2018-03-14 09:23:49 -07:00
list-objects-filter.h
list-objects.c
list-objects.h
list.h
ll-merge.c
ll-merge.h
lockfile.c
lockfile.h
log-tree.c Convert find_unique_abbrev* to struct object_id 2018-03-14 09:23:48 -07:00
log-tree.h
mailinfo.c Merge branch 'jc/mailinfo-cleanup-fix' into maint 2018-03-22 14:24:16 -07:00
mailinfo.h
mailmap.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
mailmap.h
match-trees.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
merge-blobs.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
merge-blobs.h
merge-recursive.c Revert "Merge branch 'en/rename-directory-detection'" 2018-04-11 18:07:11 +09:00
merge-recursive.h Revert "Merge branch 'en/rename-directory-detection'" 2018-04-11 18:07:11 +09:00
merge.c
mergesort.c
mergesort.h
name-hash.c
notes-cache.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
notes-cache.h
notes-merge.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
notes-merge.h
notes-utils.c
notes-utils.h
notes.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
notes.h
object-store.h pack-objects: move in_pack out of struct object_entry 2018-04-16 12:38:58 +09:00
object.c Merge branch 'sb/object-store' 2018-04-11 13:09:55 +09:00
object.h pack-objects: turn type and in_pack_type to bitfields 2018-04-16 12:38:58 +09:00
oidmap.c
oidmap.h
oidset.c
oidset.h
pack-bitmap-write.c pack-objects: move in_pack_pos out of struct object_entry 2018-04-16 12:38:58 +09:00
pack-bitmap.c pack-objects: move in_pack_pos out of struct object_entry 2018-04-16 12:38:58 +09:00
pack-bitmap.h pack-objects: move in_pack_pos out of struct object_entry 2018-04-16 12:38:58 +09:00
pack-check.c Merge branch 'sb/object-store' 2018-04-11 13:09:55 +09:00
pack-objects.c pack-objects: shrink size field in struct object_entry 2018-04-16 12:38:59 +09:00
pack-objects.h pack-objects: shrink size field in struct object_entry 2018-04-16 12:38:59 +09:00
pack-revindex.c object-store: move packed_git and packed_git_mru to object store 2018-03-26 10:05:46 -07:00
pack-revindex.h
pack-write.c
pack.h
packfile.c Merge branch 'sb/packfiles-in-repository' 2018-04-11 13:09:55 +09:00
packfile.h Merge branch 'sb/packfiles-in-repository' 2018-04-11 13:09:55 +09:00
pager.c
parse-options-cb.c
parse-options.c Merge branch 'ps/contains-id-error-message' 2018-04-10 16:28:20 +09:00
parse-options.h Merge branch 'ps/contains-id-error-message' 2018-04-10 16:28:20 +09:00
patch-delta.c
patch-ids.c
patch-ids.h
path.c repository: introduce raw object store field 2018-03-23 11:06:01 -07:00
path.h
pathspec.c
pathspec.h
pkt-line.c
pkt-line.h
preload-index.c
pretty.c strbuf: convert strbuf_add_unique_abbrev to use struct object_id 2018-03-14 09:23:48 -07:00
pretty.h
prio-queue.c
prio-queue.h
progress.c
progress.h
prompt.c
prompt.h
protocol.c
protocol.h
quote.c
quote.h
reachable.c Merge branch 'sb/object-store' 2018-04-11 13:09:55 +09:00
reachable.h
read-cache.c read-cache.c: make $GIT_TEST_SPLIT_INDEX boolean 2018-04-16 12:38:58 +09:00
ref-filter.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
ref-filter.h
reflog-walk.c
reflog-walk.h
refs.c sha1_file: convert sha1_object_info* to object_id 2018-03-14 09:23:49 -07:00
refs.h
remote-curl.c
remote-testsvn.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
remote.c sha1_file: convert sha1_object_info* to object_id 2018-03-14 09:23:49 -07:00
remote.h Merge branch 'jh/status-no-ahead-behind' 2018-03-08 12:36:24 -08:00
replace_object.c Convert lookup_replace_object to struct object_id 2018-03-14 09:23:50 -07:00
repository.c repository: introduce raw object store field 2018-03-23 11:06:01 -07:00
repository.h repository: introduce raw object store field 2018-03-23 11:06:01 -07:00
rerere.c Merge branch 'bc/object-id' 2018-04-10 08:25:45 +09:00
rerere.h completion: don't set PARSE_OPT_NOCOMPLETE on --rerere-autoupdate 2018-03-07 11:02:48 -08:00
resolve-undo.c resolve-undo: convert struct resolve_undo_info to object_id 2018-03-14 09:23:47 -07:00
resolve-undo.h resolve-undo: convert struct resolve_undo_info to object_id 2018-03-14 09:23:47 -07:00
revision.c Merge branch 'jk/cached-commit-buffer' into maint 2018-03-22 14:24:25 -07:00
revision.h
run-command.c run-command: use strbuf_addstr() for adding a string to a strbuf 2018-03-25 09:49:15 -07:00
run-command.h
send-pack.c send-pack: convert remaining functions to struct object_id 2018-03-14 09:23:48 -07:00
send-pack.h
sequencer.c Merge branch 'bc/object-id' 2018-04-10 08:25:45 +09:00
sequencer.h
server-info.c packfile: keep prepare_packed_git() private 2018-03-26 10:07:43 -07:00
setup.c Merge branch 'nd/remove-ignore-env-field' 2018-04-10 16:28:20 +09:00
sh-i18n--envsubst.c
sha1-array.c
sha1-array.h
sha1-lookup.c
sha1-lookup.h
sha1_file.c Merge branch 'sb/packfiles-in-repository' 2018-04-11 13:09:55 +09:00
sha1_name.c Merge branch 'sb/packfiles-in-repository' 2018-04-11 13:09:55 +09:00
sha1dc_git.c
sha1dc_git.h
shallow.c
shell.c
shortlog.h
show-index.c
sideband.c
sideband.h
sigchain.c
sigchain.h
split-index.c
split-index.h
strbuf.c Revert "Merge branch 'en/rename-directory-detection'" 2018-04-11 18:07:11 +09:00
strbuf.h Revert "Merge branch 'en/rename-directory-detection'" 2018-04-11 18:07:11 +09:00
streaming.c Merge branch 'sb/object-store' 2018-04-11 13:09:55 +09:00
streaming.h streaming: convert open_istream to use struct object_id 2018-03-14 09:23:49 -07:00
string-list.c
string-list.h
sub-process.c
sub-process.h
submodule-config.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
submodule-config.h
submodule.c Merge branch 'sb/object-store' 2018-04-11 13:09:55 +09:00
submodule.h
symlinks.c
tag.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
tag.h
tar.h
tempfile.c
tempfile.h
thread-utils.c
thread-utils.h
tmp-objdir.c object-store: migrate alternates struct and functions from cache.h 2018-03-23 11:06:01 -07:00
tmp-objdir.h
trace.c
trace.h
trailer.c
trailer.h
transport-helper.c
transport-internal.h
transport.c Merge branch 'sb/object-store' 2018-04-11 13:09:55 +09:00
transport.h
tree-diff.c
tree-walk.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
tree-walk.h tree-walk: convert tree entry functions to object_id 2018-03-14 09:23:50 -07:00
tree.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
tree.h tree: convert read_tree_recursive to struct object_id 2018-03-14 09:23:47 -07:00
unicode_width.h
unimplemented.sh
unix-socket.c
unix-socket.h
unpack-trees.c Revert "Merge branch 'en/rename-directory-detection'" 2018-04-11 18:07:11 +09:00
unpack-trees.h Revert "Merge branch 'en/rename-directory-detection'" 2018-04-11 18:07:11 +09:00
upload-pack.c Merge branch 'jh/partial-clone' 2018-03-29 15:39:59 -07:00
url.c
url.h
urlmatch.c
urlmatch.h
usage.c
userdiff.c Merge branch 'tl/userdiff-csharp-async' 2018-03-15 15:00:47 -07:00
userdiff.h
utf8.c
utf8.h
varint.c
varint.h
version.c
version.h
versioncmp.c
walker.c
walker.h
wildmatch.c
wildmatch.h
worktree.c
worktree.h
wrap-for-bin.sh
wrapper.c
write_or_die.c
ws.c
wt-status.c Convert find_unique_abbrev* to struct object_id 2018-03-14 09:23:48 -07:00
wt-status.h wt-status: convert struct wt_status_state to object_id 2018-03-14 09:23:48 -07:00
xdiff-interface.c sha1_file: convert read_sha1_file to struct object_id 2018-03-14 09:23:50 -07:00
xdiff-interface.h
zlib.c

README.md

Git - fast, scalable, distributed revision control system

Git is a fast, scalable, distributed revision control system with an unusually rich command set that provides both high-level operations and full access to internals.

Git is an Open Source project covered by the GNU General Public License version 2 (some parts of it are under different licenses, compatible with the GPLv2). It was originally written by Linus Torvalds with help of a group of hackers around the net.

Please read the file INSTALL for installation instructions.

Many Git online resources are accessible from https://git-scm.com/ including full documentation and Git related tools.

See Documentation/gittutorial.txt to get started, then see Documentation/giteveryday.txt for a useful minimum set of commands, and Documentation/git-.txt for documentation of each command. If git has been correctly installed, then the tutorial can also be read with man gittutorial or git help tutorial, and the documentation of each command with man git-<commandname> or git help <commandname>.

CVS users may also want to read Documentation/gitcvs-migration.txt (man gitcvs-migration or git help cvs-migration if git is installed).

The user discussion and development of Git take place on the Git mailing list -- everyone is welcome to post bug reports, feature requests, comments and patches to git@vger.kernel.org (read Documentation/SubmittingPatches for instructions on patch submission). To subscribe to the list, send an email with just "subscribe git" in the body to majordomo@vger.kernel.org. The mailing list archives are available at https://public-inbox.org/git/, http://marc.info/?l=git and other archival sites.

The maintainer frequently sends the "What's cooking" reports that list the current status of various development topics to the mailing list. The discussion following them give a good reference for project status, development direction and remaining tasks.

The name "git" was given by Linus Torvalds when he wrote the very first version. He described the tool as "the stupid content tracker" and the name as (depending on your mood):

  • random three-letter combination that is pronounceable, and not actually used by any common UNIX command. The fact that it is a mispronunciation of "get" may or may not be relevant.
  • stupid. contemptible and despicable. simple. Take your pick from the dictionary of slang.
  • "global information tracker": you're in a good mood, and it actually works for you. Angels sing, and a light suddenly fills the room.
  • "goddamn idiotic truckload of sh*t": when it breaks