milvus cdc/backup integration

[rere950303]

@SimFG thanks for your works.!

Could I know when the integration of backup and CDC functionality will be implemented?
It would be great if we could know how far the backup has progressed and have CDC continue from that point, but when making a backup request, the channel_checkpoints value is not included in the response.

[SimFG]

You can try using the latest branch of the backup and cdc tools, which currently support returning channel checkpoints.

[rere950303]

@SimFG
Even after a normal upgrade to 2.4.15, the channel_checkpoints field does not exist in the backup request response.

{
    "async": false,
    "backup_name": "test",
    "collection_names": [
        "test1_back"
    ]
}

{
    "requestId": "cc08a86b-9c1d-11ef-86c6-8edd61a93a34",
    "msg": "success",
    "data": {
        "id": "cc08a86b-9c1d-11ef-86c6-8edd61a93a34",
        "state_code": 2,
        "start_time": 1730883726343,
        "end_time": 1730883734449,
        "progress": 0,
        "name": "dsfsdf",
        "size": 0,
        "milvus_version": "v2.4.15"
    }
}

[SimFG]

@wayblink can you help checkout it?

[rere950303]

@wayblink channel_checkpoints exist in logs of cdc, but does not exist in the backup request response.

[rere950303]

@wayblink
Do we originally need to check channel_checkpoints information through log files, and is it not possible to check through backup request API responses? I'm asking because I can check it through API responses, so I'm wondering if I configured something incorrectly.

[rere950303]

I apologize. I have confirmed that it can be checked through the get_backup endpoint.