The Whites, who earned promotion last season, have impressed with their energy and discipline despite a narrow defeat to Tottenham Hotspur before the international break, a game in which Noah Okafor scored his first goal for the club.
"It is a great start," Radebe told leedsunited.com. "When you come back to the Premier League and begin like this, you give yourself a real chance. It's still early days, but the more results we can get, the better. We can build from this."
The former Leeds captain, who led the club during their memorable Champions League and top-four campaigns in the early 2000s, said maintaining momentum would be key as tougher fixtures loom.
"I know there are difficult games ahead, but the way the boys have started has been absolutely great," Radebe said. "The important thing is to keep that consistency and to improve from here."
Radebe, now a club ambassador, also emphasised the need for depth and investment to ensure Leeds remain competitive throughout the long campaign. "It was vital to start well," he said. "If you want to compete in this league, you need strength and depth. The club's plans to keep growing are exciting, Leeds are building something special again."
The South African legend recently returned to Elland Road for matches against AFC Bournemouth and Spurs, describing the experience as "emotional and inspiring".
"It's absolutely amazing to be back," he said. "To still be part of this club and feel the fans' love is an honour. Every time I walk into Elland Road, the memories come flooding back. It inspires me."
Radebe, who made more than 250 appearances for Leeds between 1994 and 2005, is also working closely with the Leeds United Foundation to strengthen community ties. "It's exciting to work with the Foundation," he added. "This club's support base is massive, and connecting with the fans is what makes Leeds so special."
As Leeds continue their Premier League journey, Radebe's message to supporters remains one of belief and pride. "This team has shown heart and resilience," he said. "If they keep playing with that spirit, the future looks very bright."