Why would you think it's not a problem? If your eyes on the phone they aren't on the road, I can't tell you how many accidents I have avoided simply because I was paying attention. Many of them required action that split second.
I totally agree taking your eyes off the road for any reason is a big cause of accidents. I was talking about how people slow to a dangerously slow speed on the hi way because they are deep in conversation. also how pointless the the hands free law is. Most of the time people are still taking there eyes off the road to dial and to answer(see who's calling) the phone.