Skip to main content
Software Engineering

You are not logged in. Your edit will be placed in a queue until it is peer reviewed.

We welcome edits that make the post easier to understand and more valuable for readers. Because community members review edits, please try to make the post substantially better than how you found it, for example, by fixing grammar or adding additional resources and hyperlinks.

Required fields*

8
  • Did you try Psyco? psyco.sourceforge.net/introduction.html I don't know if it works with Pandas, but it may be worth a try. Commented Feb 7, 2014 at 16:32
  • I'm using Python 2.7... I believe Psycho is for 2.5 or earlier. Thanks though. Commented Feb 7, 2014 at 17:08
  • 1
    PyPy supposedly can provide some good speedups due to taking better advantage of your hardware Commented Feb 7, 2014 at 17:16
  • 2
    Have you considered something more specialized such as R (r-project.org)? But, if you are going to stick with a general purpose language, I'd be suprised if the language itself was the actual bottleneck here. It sounds like this is all with flat files. If thats the case, I'd profile your file reads to make sure thats not whats slowing things. Commented Feb 7, 2014 at 20:55
  • 2
    I use Python Pandas with Gigabyte sized files and complex calculations with no speed issues,, something is strange and there is not enough here to diagnose the issue. Commented Feb 8, 2014 at 18:49