Omni-Path?

[Zarathustra[H]]

So,

100gig Intel Omni-Patch adapters have become really cheap on eBay.

I've been trying to read up on Omni-path, but a lot of it is industry jargon gibberish to me.

My question for someone who knows more about this stuff than I do, is there any way to use these Omni-Path adapters as ethernet adapters, or in an ethernet-like manner?

I'm envisioning a direct link using a QSFP28 DAC. Would be nice if I could push files over it via NFS and/or SMB, direct machine to machine.

I have no idea if this might work.

Appreciate any thoughts.

 

[toast0]

I found this discussion about it. https://forum.level1techs.com/t/proxmox-with-intel-omni-path-fabric-how-to-cautionary-tale/198762

Sounds like an adventure, but should be doable. Especially if you're considering just two, it should work. But it also sounds like cpu usage will be high, and you might have to hunt for a kernel that doesn't crash.

Personally, my home 'servers' are terribly underpowered and I can't get them all the way up to 10g, so no sense in me going beyond that, but I'm a cheapass and my servers get no budget, so ymmv.