Java wasn't made with game development in mind, Java was made to be a language "for the web".

As for game development, Sun didn't really support Java as a game development language as Microsoft backed C#.

I think the lack of compelling game development frameworks is what really killed Java in this aspect.