The singer talks about partying with Lindsay Lohan and Paris Hilton, stepping into Freddie Mercury’s shoes, and trading theatricality for introspection on his new album