Sean Carroll in Preposterous Universe:
Defining the concept of “science” is a notoriously tricky business. In particular, there is long-running debate over the demarcation problem, which asks where we should draw the line between science and non-science. I won’t be providing final any final answers to this question here. But I do believe that we can parcel out the difficulties into certain distinct classes, based on a simple scheme for describing how science works. Essentially, science consists of the following three-part process:
- Think of every possible way the world could be. Label each way an “hypothesis.”
- Look at how the world actually is. Call what you see “data” (or “evidence”).
- Where possible, choose the hypothesis that provides the best fit to the data.
The steps are not necessarily in chronological order; sometimes the data come first, sometimes it’s the hypotheses. This is basically what’s known as the hypothetico-deductive method, although I’m intentionally being more vague because I certainly don’t think this provides a final-answer definition of “science.”
The reason why it’s hard to provide a cut-and-dried definition of “science” is that every one of these three steps is highly problematic in its own way.
More here.