fix a bug where 'gotadmin pack' packed too many objects unless -a was used

explicitly include <unistd.h> for close(2)

print additional progress information while packing ok op@

cache a list of known pack index files when the repository is opened Avoids overhead due to readdir calls while searching a pack index. ok op@

portable: pack-create: remove endian.h endian.h is portably included on non-OpenBSD systems, so let that mechanism determine if it should be included or not.

explicitly include <endian.h> for be32toh()

fix pack.sh test failure from reuse-deltas patch by tweaking progress output

reuse existing deltas when creating pack files tested by thomas, naddy, and myself

compress delta data from delta_cache directly into pack file

set a cap on the amount of memory we use to store encoded deltas

encode short deltas in memory instead of writing them to a temporary file

map raw object files into memory while packing if possible

only open raw objects if necessary while writing out pack file data significantly speeds up the "writing pack: " step of gotadmin pack

portable: FreeBSD: remove sha1.h sha1.h will be included portably.

use time-based rate-limiting for gotadmin progress output Suggested by naddy some time ago. ok tracey

use up to 128 delta chain elements again; creates smaller packs at same speed

try only 3 delta base candidates instead of 10 to speed up packing Tests by kn, thomas_adam and myself made on various repositories indicate that 3 is a good choice. Tyring 10 deltas is much slower and does not result in significantly smaller pack files.

portable: tree/queue header fixes sys/{tree,queue}.h are looked up via configure, and therefore are included via that mechanism.

Revert "cache raw objects in order to speed up gotadmin pack" This reverts commit c565dfd37a157bab9556aceac96ff27d64525fc9.

cache raw objects in order to speed up gotadmin pack

use RB_TREE instead of STAILQ to manage packindex bloom filters; much faster

portable: update to handle bloom, etc Update portable to support changes for bloom, etc.

move encode_delta() in pack_create.c to eliminate a forward declaration

while packing, store encoded deltas in a temporary file instead of in memory

limit delta chain length in newly created pack files to 32 deltas Our former limit was 128 which is fairly high. Git uses 50 by default. A smaller limit results in slightly larger pack files but makes both packing and unpacking faster.