"They were very theatrical. Alex Harvey was 40 something, he was an old guy. And - at the time - that was ancient for rock n roll. He won the Scottish Tommy Steele competition in 1957. The prize? Meeting Tommy Steele! What a bizarre business. That was two years before I was born and he must have been in his late teens/early 20s by then. To be in your early 40s and starting out was unheard of. David Bowie and Alex Harvey knew each other, actually: they bonded over a shared love of Jacques Brel. 'Faith Healer' is one of the best things that ever came out of the 70s. And the end triplet of 'Last Of The Teenage Idols' – which is about the competition that he won. That was amazing. I loved his voice: he screamed his way through life. His version of 'Crazy Horses' is hilarious. He did a song called 'There's No Lights on the Xmas Tree Mother… They're Burning Big Louis Tonight'. It was about a guy in the electric chair who takes all the power off the grid on the night of his death. Nobody in this little town in America gets the Xmas lights. What a brilliant idea for a song. It was theatrics and bravado. Alex Harvey was off kilter - it wasn't like The Sweet or Mud, he was musically brilliant."

"This was the great danger of me picking these records - that they'd all come from 1974, but that was when I was most enthusiastic about buying records. And Marquee Moon… I just played it over and over and over again. I just love it. US punk was very different [to UK punk]; over here, the concept of it was absolutely fantastic, and that was the whole thing that got me into it, but it was a bit one dimensional. The Ramones were great, but they were kind of a caricature - a cartoon band. And a lot of punk over here seemed to go for that, as a backlash against over sophistication. I just felt that Marquee Moon and the stuff from New York was odd, and it was different, and it was weird - and I always liked weird thing. It still had a lot of energy; I liked Marquee Moon in preference to, say, Patti Smith's Horses… it was just contrived enough. Any further and it would be too pretentious. It's still great today; as soon as I put it on and hear those first few bars of 'See No Evil', it reminds me of when it first came out and I played it non-stop. Although imagine my disappointment when I bought Adventure on the red vinyl and tried desperately to like 'Foxhole', and it didn't happen."

"I'm a huge Patti Smith fan; if ever there was an artist who continues to inspire me through decade after decade, it would be Patti Smith. I really hold her in the highest of regard – a woman who has never compromised, has never sold herself for commerciality or success: I admire her so much for that. 

 I guess I picked Wave because my absolute favourite Patti Smith song is on that record: 'Revenge'. I could have easily picked Horses which I feel has been talked about a million times before but I always feel like Wave just doesn't really get quite the same love. 'Revenge' is just a song that I turn to over and over when I feel furious [laughs]. 'Kimberly' is on there too and I covered that with my middle band, Angelfish. 

 I [first discovered Smith] when I was in Goodbye Mr Mackenzie and the lead singer was always introducing me to amazing music. He said: ""I really think you should check out Patti Smith, I think you'd really love her,"" before giving me Horses. I took it home and played it on my old record player and just fell insanely in love. 

 I love the androgynous sound of her voice and her power. I'd always been looking for non-conforming female voices and she embodied it; I found it in her. 

 She's also never let me down. You know how you can fall in love with artists and sometimes they leave you out in the cold as their careers continue – they maybe decide to sell themselves cheap, or they fall by the wayside or they can't get their shit together. There's a million and one reasons why artists can let us down but I've never felt let down by her. She remains an incredible beacon for me and someone I always turn to – whether it's her music or her writing or her performances; she fills me with awe. 

 And you eventually got to perform on the same line up as her… 
 I had never seen Patti Smith perform until we shared a stage with her – she actually opened for Garbage. I was so embarrassed and so shocked that the music business was so ridiculous that we were top of the bill and Patti Smith was opening for us. It taught me a great lesson, actually, about what popular success is and what actually it means to be an artist with longevity. It was a humbling lesson and one which I was very aware of at the time and very embarrassed about. 

 She was, of course, as gracious as you would expect her to be. I got to meet her and I burst into tears [laughs]. But it was the first time I had ever seen her actually physically perform – that was the first time I'd ever seen her in the flesh. "