The new kit, launched before Germany host the European Championship in June and July, debuted during their 2-0 friendly win over France last month.
"The DFB checks the numbers 0-9 and then submits the numbers 1-26 to UEFA for review. None of the parties involved saw any proximity to Nazi symbolism in the creation process of the jersey design," the DFB said in a statement on social media platform X.
"Nevertheless, we take the comments very seriously and do not want to provide a platform for discussions... we will develop an alternative design for the number 4 and coordinate it with UEFA."
The DFB's official supplier adidas had earlier said that they would remove the number 44 from their range of customisation options.
"We will block the number 44 as quickly as possible," adidas spokesman Oliver Bruggen told German media.
"As a company we actively oppose xenophobia, anti-Semitism, violence and hatred in any form."