The New York Red Bulls forward put the United States ahead in the 12th minute and, after Leandro Lima tied it in the 64th, converted off a deflection in the 81st for the win. The victory helped the Americans finish atop Group D with seven points.

The U.S. moves into the round of 16 and will face a third-place team from one of the other groups in Toronto on Wednesday.

The result left Brazil — which also lost to Poland in its opener — with just three points and hoping to secure one of four berths given to third-place teams.

With thousands in the capacity crowd of 26,500 dressed in the yellow of the Canarinhos — dancing to the beating of drums and chanting "Bra-sil, Bra-sil," the Americans faced a partisan atmosphere at Frank Clair Stadium.

Brazil played the match with Benfica David Marinho, who received a four-match ban earlier in the day for an elbow to South Korea's Shin Young-rok in Tuesday's match that sent the Korean to the hospital.

Both teams had chances early, but it was the U.S. that capitalized first when Altidore handled Renato Augusto at midfield.

While the Brazilian fell looking for a whistle from Spanish referee Alberto Undiano Mallenco, Altidore dribbled to the edge of the penalty area and fired a low, angled drive that eluded goalkeeper Cassio.

The Brazilians used physical play to tie the match.

U.S. goalkeeper Chris Seitz couldn't hang on to Augusto's hard volley from the top of the penalty area and before he could smother the rebound, Lima outmuscled a defender and poked it across the goal line.

But just when it looked like Brazil had done enough, the U.S. converted on one of its rare forays into Brazil territory in the second half.