Zoekt Indexer creates too many index files
Summary
This is a continuation of Zoekt Indexer: Add merge API (#432240 - closed) and the issue that should resolve the problems we've been experiencing over the last few months. For example:
- Sporadic Bad Gateway 502 user-specific errors i... (#430182 - closed)
- 2023-12-13: Zoekt code search failing for some ... (gitlab-com/gl-infra/production#17266 - closed)