Employees at the bank, located at 318 South Washington Street, said they arrived to work and discovered that their ATM had been damaged.
The Green Bay Police Department responded to the scene and reviewed a surveillance tape.
No money was taken from the ATM.
As police were investigating the incident, they were called to the Quality Inn and Suites, across the street from the bank.
That's where they found 40-year-old Vincent Hassell, damaging property.
Police say he was homeless and looking for money to get a car and get out of town.
Police say Hassell was the man seen on the bank's surveillance tape.
Hassel is in jail on charges of Attempted Burglary, Felony Criminal Damage to Property and Entry to a Locked Coin Box.