A man has drowned on Phillip Island, south of Melbourne, just one week after someone died while going for a swim on Christmas Day.

The man got into difficulty while swimming at Woolamai Beach, but rescue attempts to reach him were not successful.

Police said his body was found about 20 minutes later.

The man is yet to be formally identified.

Woolamai Beach is the same place a Queensland man drowned while going for a Christmas Day swim with his family.

The 29-year-old had come to the beach with family, and was swimming at 5:30pm when he got into difficulty.

Police will prepare a report on today’s death for the Coroner.

-AAP