Alright, the Sitecore.ContentSearch.Azure.dllSitecore.ContentSearch.Azure.dll
file in the CD was not (by default) the same version as in the CM. I copied the CM version to the CD bin folder and it works. (but I have no idea why the default installation puts two different files)
Here is a comparison of the detail of the two dlls,