Would it be correct for an atheist to say "I adhere to science"?

You cannot adhere to Science. Science is a field not a concept. You can adhere to rationality and the scientific method, and most Atheists would probably state that they adhere to rationality.