In 1994, Droese was signed to a contract by the World Wrestling Federation. Droese debuted as Duke "The Dumpster" Droese, a garbage man who carried a trash can to the ring. He debuted in late 1994 as an opponent for color commentator Jerry Lawler. In the course of a confrontation with Lawler, Droese was struck in the head with his own can, one of the first instances of hardcore wrestling on WWF Monday Night Raw.
Droese took part in the 1995 Royal Rumble and the 1995 King of the Ring, but did not win at either event. Later in 1995, Droese began feuding with Hunter Hearst Helmsley. At the 1996 Royal Rumble, Droese handed Helmsley his first WWF loss by disqualification in a match with the stipulation that the winner would enter the Royal Rumble match at number 30, while the loser would be obliged to enter at number one. Despite entering at number 30, Droese failed to win the Royal Rumble, and was eliminated by Diesel and Kama. The feud between Droese and Helmsley intensified on the January 27, 1996 edition of Superstars, when Helmsley attacked Droese after his match and cut off his hair. The feud culminated in a match that Helmsley won at In Your House 6 on February 18. Droese left the WWF in the summer of 1996.
Droese returned to the WWF for a single night on April 1, 2001 at WrestleMania X-Seven, participating in the "gimmick battle royal", which was won by the Iron Sheik.