Ronald Dworkin in the NYRB:
The familiar stark divide between people of religion and without religion is too crude. Many millions of people who count themselves atheists have convictions and experiences very like and just as profound as those that believers count as religious. They say that though they do not believe in a “personal” god, they nevertheless believe in a “force” in the universe “greater than we are.” They feel an inescapable responsibility to live their lives well, with due respect for the lives of others; they take pride in a life they think well lived and suffer sometimes inconsolable regret at a life they think, in retrospect, wasted. They find the Grand Canyon not just arresting but breathtakingly and eerily wonderful. They are not simply interested in the latest discoveries about the vast universe but enthralled by them. These are not, for them, just a matter of immediate sensuous and otherwise inexplicable response. They express a conviction that the force and wonder they sense are real, just as real as planets or pain, that moral truth and natural wonder do not simply evoke awe but call for it.
There are famous and poetic expressions of the same set of attitudes. Albert Einstein said that though an atheist he was a deeply religious man:
To know that what is impenetrable to us really exists, manifesting itself as the highest wisdom and the most radiant beauty which our dull faculties can comprehend only in their most primitive forms—this knowledge, this feeling, is at the center of true religiousness. In this sense, and in this sense only, I belong in the ranks of devoutly religious men.
Percy Bysshe Shelley declared himself an atheist who nevertheless felt that “The awful shadow of some unseen Power/Floats though unseen among us….” Philosophers, historians, and sociologists of religion have insisted on an account of religious experience that finds a place for religious atheism. William James said that one of the two essentials of religion is a sense of fundamentality: that there are “things in the universe,” as he put it, “that throw the last stone.” Theists have a god for that role, but an atheist can think that the importance of living well throws the last stone, that there is nothing more basic on which that responsibility rests or needs to rest.