I'm thinking of starting a business that would list good contractors. Not just based on consumer comments but actually checking to verify their information is correct. There is a service similar to this that I know of but it doesn't verify the contractors information it only lists consumer comments.

Do you think this would be a good idea.

Is the similar service Angie's list? If so, they DO verify the contractors information/ address/ name etc. and send the contractor the customer's report before posting.( I am a new member and it took probably 2 months for verification and posting).
Anyhow, I still think it is a good idea. Anything other than picking out a contractor from yellow pages will serve consumers well.
Maybe you could make your's more localized?

When I lived in Indiana there was a couple who ran a similar business and they are very successful. They check references and background as well on these people and when the worker gets a job they pay a referral fee to the owners of these business.

No message