After World War II the responsibility for the security of Germany as a whole rested with the four Allied Powers: the United States, the United Kingdom, France and the Soviet Union. Germany had been without armed forces since the Wehrmacht was dissolved following World War II. When the Federal Republic of Germany was founded in 1949, it was without a military. Germany remained completely demilitarized and any plans for a German military were forbidden by Allied regulations. Only some naval mine-sweeping units continued to exist, but they remained unarmed and under Allied control and did not serve as a national defence force. Even the Federal Border Protection Force, a mobile, lightly armed police force of 10,000 men, was only formed in 1951. A proposal to integrate West German troops with soldiers of France, Belgium, the Netherlands, Luxembourg and Italy in a European Defence Community was proposed but never implemented.

There was a discussion between the United States, the United Kingdom and France over the issue of a revived (West) German military. In particular, France was reluctant to allow Germany to rearm in light of recent history (Germany had invaded France twice in living memory, in World War I and World War II, and also defeated France in the Franco-German War of 1870/71; (see also French–German enmity)). However, after the project for a European Defence Community failed in the French National Assembly in 1954, France agreed to West German accession to NATO and rearmament.

With growing tensions between the Soviet Union and the West, especially after the Korean War, this policy was to be revised. While the German Democratic Republic (East Germany) was already secretly rearming, the seeds of a new West German force started in 1950 when former high-ranking German officers were tasked by Chancellor Konrad Adenauer to discuss the options for West German rearmament. The results of a meeting in the monastery of Himmerod formed the conceptual base to build the new armed forces in West Germany. The Amt Blank (Blank Agency, named after its director Theodor Blank), the predecessor of the later Federal Ministry of Defense, was formed the same year to prepare the establishment of the future forces. Hasso von Manteuffel, a former general of the Wehrmacht and liberal politician, submitted the name Bundeswehr for the new forces. This name was later confirmed by the West German Bundestag.

The Bundeswehr was officially established on the 200th birthday of Scharnhorst on 12 November 1955. In personnel and education terms, the most important initial feature of the new German armed forces was to be their orientation as citizen defenders of a democratic state, fully subordinate to the political leadership of the country. A personnel screening committee was created to make sure that the future colonels and generals of the armed forces were those whose political attitude and experience would be acceptable to the new democratic state. There were a few key reformers, such as General Ulrich de Maiziere, General Graf von Kielmansegg, and Graf von Baudissin, who reemphasised some of the more democratic parts of Germany’s armed forces history in order to establish a solid civil-military basis to build upon.