NEW YORK — Wall Street retreated yesterday after Fannie Mae and Freddie Mac fell to their lowest levels in nearly 20 years on concerns that the government might need to bail out the mortgage financiers.

Weakness in the overall financial sector sent the Dow Jones Industrial Average down 180.51, or 1.55 percent, to 11,479.39. The Dow had been down about 225 points at its lows of the session.

Broader stock indicators also declined. The Standard & Poor’s 500 index fell 19.60, or 1.51 percent, to 1,278.60, and the Nasdaq composite index fell 35.54, or 1.45 percent, to 2,416.98.

Stocks of Rhode Island importance fell, led by Bank Of America Corp. and Hasbro Inc. The Bloomberg Rhode Island Index, a price-weighted list of companies with operations in the region, fell 3.51 to 249.79. Bank Of America fell $1.40 to $29.30. Hasbro fell $1.20 to $38.49.

Investors were again uneasy about the health of financial companies after media reports of further problems in the sector. Barron’s news magazine said the U.S. Treasury might have to bail out government-chartered Fannie and Freddie, which, the weekly noted, would likely wipe out shareholders’ equity in the companies.

Meanwhile, The Wall Street Journal, citing unidentified sources, reported that Lehman Brothers Holdings Inc. might surprise Wall Street with weaker-than-expected third-quarter results.

The continuing bad news about financials wasn’t a surprise, but it nonetheless depressed a market that is hoping for concrete signs that banks and brokerages can put the year-old credit crisis behind them and return to significant profit growth.

Even neutral news about the housing market couldn’t ease Wall Street’s mood. The National Association of Home Builders’ monthly index on the housing market remained flat at 16 in August. That met the predictions of economists surveyed by Thomson Financial/IFR. Benchmarks related to current sales and expectations of future sales improved, but not enough to move investors to buy.

Todd Leone, managing director of equity trading at Cowen & Co., said the worries about Fannie and Freddie dominated market sentiment in an otherwise light day.

“It’ll be one of the slowest days of the year and I think it just kind of fed into itself,” he said, referring to the effects of very light volume and the unease over the mortgage companies.

Last week, the Dow finished lower, but the S&P and the Nasdaq composite index ended higher, with financial sector problems again helping to bring stocks down.

Fannie Mae shares fell $1.76, or 22 percent, to $6.15, and Freddie Mac fell $1.46, or 25 percent, to $4.39, after the Barron’s report.

Lehman shares fell $1.14, or 7.1 percent, to $15.03, after the Journal’s report.

UnionBanCal Corp. was one of the exceptions in the financial sector. Japanese bank Mitsubishi UFJ Financial Group Inc. raised its bid to buy the rest of UnionBanCal, the California bank that it partially owns, to $7.69 a share in a deal worth $3.5 billion. UnionBanCal shares rose $7.69, or 12 percent, to $73.18.

Oil prices declined slightly after briefly jumping above $115 per barrel as Tropical Storm Fay approached Florida, but appeared unlikely to disrupt installations in the Gulf of Mexico. Light, sweet crude fell 90 cents to settle at $112.87 a barrel on the New York Mercantile Exchange, after rising as high as $115.35.

Crude’s retreat — down more than $35 from its record high of $147.27 set July 11 — has given the stock market a boost over the past month. But Wall Street has generally backtracked from its rallies amid continuing signs of problems among financial companies and also on unexpected signs of weakness in the economy.

Bonds rose modestly. The yield on the benchmark 10-year Treasury note, which moves opposite its price, fell to 3.82 percent from 3.84 percent late Friday.

Yesterday, the dollar was mixed against other major currencies, while gold prices rose.

John Merrill, chief investment officer at Tanglewood Wealth Management, said investors are realizing that the financial sector troubles aren’t likely to soon disappear.

“The degree and depth of what’s happening in the financial industry is beyond anything we’ve seen in decades and it takes time to get your arms around the severity of what’s happening and what the long-term and short-term ramifications are,” he said.

In corporate news, Lowe’s Cos. rose 4 cents to $24.54 after issuing a third-quarter forecast that came in below analysts’ expectations, adding to investors’ uneasiness about consumer spending and also about the housing market. The home improvement retailer, however, posted a smaller-than-expected decline in second-quarter profit, and raised its outlook for the year.

Video game publisher Electronic Arts Inc. is retracting its hostile bid for smaller rival Take-Two Interactive Software Inc., but a deal — and a friendly one at that — is likelier than ever.

Take-Two, best known for the popular “Grand Theft Auto” video game series, confirmed yesterday that it expects to sign a confidentiality agreement with EA to begin formal discussions about “strategic alternatives.”

EA had said earlier it wouldn’t extend the Monday night deadline for its $2-billion tender offer to buy Take-Two. The companies have been unable to agree on a price for the past six months.

Now, EA says that if it does buy Take-Two, it no longer believes it can combine the company in time for the holidays, when video game companies make most of their money. Because of this, EA said it needs to review assumptions made to support its offer price of $25.74 per share.

Shares of New York-based Take-Two slid $1.09, or 4.4 percent, to $23.75. This is still well above $17.36, the stock’s closing price on Feb. 22, the last trading day before EA announced its offer of $25.74 per share.

The Russell 2000 index of smaller companies fell 11.40, or 1.51 percent, to 741.97.

Declining issues outnumbered advancers by about 3 to 1 on the New York Stock Exchange, where consoliated volume came to a light 3.75 billion shares compared with 3.99 billion Friday. Light volume can exacerbate price movement.

Overseas, Japan’s Nikkei stock average rose 1.12 percent. Britain’s FTSE 100 slipped 0.08 percent, Germany’s DAX index fell 0.20 percent, and France’s CAC-40 lost 0.11 percent.