Unhappy Plum Tree - Can it be rescued?

[Plumtree]

I am hoping for some help or reassurance over my plum tree. Finally started to put some fruit trees into the garden and thought would start with a plum tree. Seemed happy sat in the pot on the lawn waiting to go, created a border for it, planted, watered and thought all would be fine. Then I noticed all the new buds had died and now what leaves it did have are curling up and turning brown - see photo. Had a look for similar issues - have seen leaf curl mentioned but there are no aphids, there is no puss from the branches although one seems to be splitting and seems very dry. I assumed it was lack of water but when I forked the ground it seems very moist. Has anyone seen anything similar? My house is newish build (early 00's) so the soil isn't great - and had to dig a lot of broken brick out the ground just to get the hole deep enough, so not sure if that is helping. It was planted mid April - so has been in 4 weeks.

[boundtothesoil]

Young leaves on plum trees can be very sensitive to wind and frost damage, resulting in discoloration and stunting of their expansion. If it were my tree I'd just wait and see how it fares during the rest of the growing season this year. Not worth spraying and definitely don't over water it.

[fishpond]

As this Plum tree is possibly going to be in the ground for many years, how did you prepare the planting site?
Was it a tree from one of the supermarkets or from a specialist nursery/garden centre?
Any idea what the rootstock is?

[Plumtree]

Ah well it was planted not long before we had some really cold nights - so many that hasn't helped then. It is a Saint Julian A, I will admit I had grand plans to build up the soil level in the border before I planted anything to give it all a bit more of a chance but a sunny bank holiday meant I just dug the hole pour a bit of compost in - put in tree - added more compost. I'm not sure if having a large conifer hedge on the other side of the fence may be an issue - I was paranoid over it being under watered because one of the branches looked dry and splitting but I think that was misplaced.

Time maybe the best plan - I was worried I'd done something to it or that where I have planted wasn't suitable for it and partially hoping there was a miracle fix, but actually I'm happy to wait as long as it isn't dying or I've done something to it that needs fixing.