Are backlinks important?

SEO is basically a popularity contest in terms of backlinks, and the more backlinks you get, the more popular you are, and the higher you're going to rank, but just how important are backlinks? Can you rank without them? Do you need to focus only on building backlinks?