Alot of guys around here have either a .223 and 22-250 for Woodchucks and Coyotes, but I've yet to meet any that would use them for deer, even at close range.
When our country changed to allow rifle a number of years ago, I asked around about using my .223, but couldn't find anyone who would say it was a good way to go. All of them, like Jeff brought up, said shot placement with a bullet that small and light is too critical,.... and the deer don't always give you the optimum angle for critical shots.
Not sure how big your deer get, but Black Hills has a very good 60 gr soft point if your gonna try it.
Paul.