If you have access to a vertical mill, tram it up(square it), and use a reamer to finish the holes. WAY more accurate than a drill press.
Use a hardened and ground dowel pin for location, press fit in one part, slight (.0005"/.001") clearance in the mating part.
Just my 2 cents
F/B