The Greens “lost their way” by stalling key bills in the Senate and have paid a price at the ballot box, Anthony Albanese says.