[discovery] Split lakeFS packages with controllable dependencies

[arielshaqed]

Modify lakeFS to allow using individual components in a controlled disciplined manner. The goal is to allow other these components to be used in external projects. On a small scale, think of logging, cache, maybe some config helpers. On a larger scale, think of extracting KV.

[arielshaqed]

One way to do this might be to make it a multi-module workspace. Here's a brief tutorial on multi-module workspaces. In brief, this would create smaller modules which would have smaller dependencies - and no circular dependencies! As a first step, we might create a github.com/treeverse/lakefs/util that has no lakeFS dependencies, and includes logging, maybe some config helpers, cache, maybe testutil. #7616 was an earlier attempt to do this.

[itaiad200]