How to get someone to open up?

If you're talking to someone and they're giving you one word answers, would it be effective to say "ok, I get it. I'll leave you be" or is that too mean/futile?