When you say it's less than 20MB, do you mean substantially? Files actually take more space than they show--although the difference is dependent on how the hard drive is setup.
Have you printed your PDF to Microsoft Print to PDF, to see if a brand new save works any better?