Julianne,
Driving is a big responsibility. I can understand why you would be nervous about it. Another thing that may be making the panic worse is when you feel the stress of other people getting frustrated with you. Just take your time and do it at your own pace. If the panic/anxiety continues, see your family doctor, and just explain what has been happening. Your not alone, even people who don't have panic/anxiety disorder have stress when it comes to driving. Keep posting your thoughts and let us know how you are doing. We're here for you.
Take care,
Susanne