Does a little daily marijuana affect my memory?

I don't know if marijuana use is proven to affect memory. Clearly it helps you cope with life, and it may not affect your health significantly, but I recommend you do some research to help you understand the risks, and possibly consult your Doctor for advice.

As a counsellor I recommend you consider safe alternatives, and of course one is to work on what makes you anxious. Various kinds of therapy might help you. CBT is an increasingly popular therapy that may help if the anxiety is happens in particular suggestions. Or more relationship focussed therapies may help when it arises around people, or where an underlying issue keeps creating anxiety in one situation after another.

I'm sorry I can't answer your specific question but hope you find this helpful.