At the speeds you will be running, I don't think it matters. So you might as well keep the swingarm. If you were going fast, such as 150 and above I think you would need a good suspension to keep the tire in contact. Having a suspension can only help, not hurt.
Good luck. Keep up advised of your progress.
Don