(CBS/AP) NEW YORK -- Rebuking Mitt Romney, President Obama said Tuesday that Americans are not "victims" and that anyone seeking the presidency ought to be working for "everyone, not just some."
Mr. Obama's remarks came after a secretly taped and newly released video of the Republican presidential nominee showed Romney describing "47 percent of the people" as Obama supporters who depend on government and believe they are victims.
"My expectation is that if you want to be president, you have to work for everyone, not just for some," Mr. Obama said in a taping of the "Late Show" with David Letterman.
It was Mr. Obama's first response to the Romney video, which roiled Romney's campaign and put him on the defensive about his views about nearly half the nation.
In the video, taken during a May fundraiser and posted online Monday, Romney said it is not his job "to worry about those people." He was referring to what he called the president's locked-in supporters who believe they are "entitled to health care, to food, to housing, to you name it."
Romney has since said he made his point inelegantly in trying to describe differing visions for the nation.
"There are not a lot of people out there who think they are victims" or simply entitled, Mr. Obama said.
In traveling across the country, the president said, "You don't meet anybody who doesn't believe in the American dream and the fact that nobody is entitled to success (and) that you've got to work hard. (See video at left) And so, I promise you, there are not a lot of people out there who think they're victims. There are not a lot of people who think that they're entitled to something. What I think the majority of people, Democrats and Republicans believe is that we've got some obligations to each other, and there's nothing wrong with us giving each other a helping hand."
Mr. Obama also said he didn't know what Romney was even referring to with his "47 percent reference."
The president said that when he won in 2008, 47 percent was the amount of voters who went for his opponent, Republican Sen. John McCain. McCain actually got about 46 percent of the popular vote.
Current polling shows Mr. Obama with a slight edge over Romney.
"One thing I've learned as president," Mr. Obama said, "is that you represent the entire country."
Mr. Obama said people understand that the presidential candidates will make mistakes on the campaign trail. He said that includes one he regrets from 2008, when audio from one of his own private fundraisers had him saying that some residents of depressed rural areas get bitter and "cling to guns or religion or antipathy to people who aren't like them."
Having said that, Mr. Obama added: "What I think people want to be sure of is you are not writing off big chunks of the country."
He also commented on the attack on the U.S. consulate in Benghazi, Libya that resulted in the deaths of four Americans, including Ambassador Christopher Stevens, saying it wasn't an act of war, and that, as offensive as the anti-Islam video was that the protest at the consulate began over, it wasn't an excuse for violence.
The president appeared on the TV show before a night of fundraising in New York City.
© 2012 CBS Interactive Inc. All Rights Reserved. This material may not be published, broadcast, rewritten, or redistributed. The Associated Press contributed to this report.