diff options
| author | Taras Madan <tarasmadan@google.com> | 2025-04-02 20:28:15 +0200 |
|---|---|---|
| committer | Taras Madan <tarasmadan@google.com> | 2025-04-04 14:52:42 +0000 |
| commit | c53ea9c902c6745d750c5700631e1556716f4cd4 (patch) | |
| tree | 855f9483db0aeedee6fe7dbd34e746356db13085 /executor/executor.cc | |
| parent | 1c4febdbbe8f34403baef506b22cd689576927f6 (diff) | |
pkg/covermerger: read gcs files sequentially
Quarter long aggregation means thousands of gzip files.
Opening all the files in parallel we struggle from:
1. Memory overhead.
2. GCS API errors. It can't read Attrs for 1500+ files.
Diffstat (limited to 'executor/executor.cc')
0 files changed, 0 insertions, 0 deletions