author | Shawn O. Pearce <spearce@spearce.org> | |
Mon, 1 Feb 2010 17:27:35 +0000 (09:27 -0800) | ||
committer | Junio C Hamano <gitster@pobox.com> | |
Mon, 1 Feb 2010 20:09:47 +0000 (12:09 -0800) | ||
commit | 5eef828bc03649ba11acc05c983d72823c27f0bb | |
tree | 2554847a2c6f7853bf2b9b8226de1ccca67ce828 | tree | snapshot |
parent | 63d04a78043c61c52ae437fa6106e7029b466bbf | commit | diff |
fast-import: Stream very large blobs directly to pack
If a blob is larger than the configured big-file-threshold, instead
of reading it into a single buffer obtained from malloc, stream it
onto the end of the current pack file. Streaming the larger objects
into the pack avoids the 4+ GiB memory footprint that occurs when
fast-import is processing 2+ GiB blobs.
Signed-off-by: Shawn O. Pearce <spearce@spearce.org>
Signed-off-by: Junio C Hamano <gitster@pobox.com>
If a blob is larger than the configured big-file-threshold, instead
of reading it into a single buffer obtained from malloc, stream it
onto the end of the current pack file. Streaming the larger objects
into the pack avoids the 4+ GiB memory footprint that occurs when
fast-import is processing 2+ GiB blobs.
Signed-off-by: Shawn O. Pearce <spearce@spearce.org>
Signed-off-by: Junio C Hamano <gitster@pobox.com>