Don't worry! Here is the situation:
We aren’t able to remove the download button from the store page, but rest assured, it is not necessary to access your recently purchased DLC(s).
Simply launch the game and you will be able to use your newly purchased items without issue.
Sorry for the trouble/confusion!