I can hold any number of viking ships on Fall (survival, harder dificulty) with no issues. Learn some strategy and positioning. Usually a good defense with 6~10 archer towers, 4~6 ballistas and a few archer soldiers will stop anything. Also, not hard to keep your tax in 40% or even 50% if you make the citizens happy.