Why do people say Portal/Portal 2 is a difficult game?

I find the game very easy. When I thought of buying it from Steam, I presumed that it would be very difficult and interesting as many of my friends told me. I don't know why they find it difficult. What is your opinion and take on the Portal Series. Although I have gone a long way through, I don't understand the story behind it.