As far as I can tell it should be possible to reuse this fine tuning code entirely and just replace `--embedder_name_or_path BAAI/bge-base-en-v1.5` with `--embedder_name_or_path MongoDB/mdbr-leaf-ir`
Note that bge-base-en-v1.5 is a 110M params model - our is 23M.
* BEIR performance is bge=53.23 vs ours=53.55
* RTEB performance is bge=43.75 vs ours=44.82
-> overall they should be very similar, except ours is 5x smaller and hence that much faster.
Note that bge-base-en-v1.5 is a 110M params model - our is 23M. * BEIR performance is bge=53.23 vs ours=53.55 * RTEB performance is bge=43.75 vs ours=44.82 -> overall they should be very similar, except ours is 5x smaller and hence that much faster.