Answer by NicoLocke

Okay, I believe this issue is caused by the lightmap UV not filling the entire UV space. instead of using your own lightmap, try enabling generate uv lightmaps in the inspector for the model.