Is this basically what Atheists believe?

No. Atheist =/= scientists. There are isolated tribes in the Amazon and Australia that don't believe in god and they've never heard of the big bang or evolution.