Comments on: Parallel python and GIS http://www.perrygeo.net/wordpress/?p=82 Matt Perry's random adventures with geospatial technology and other tangentially related topics Mon, 06 Sep 2010 17:51:29 +0000 http://wordpress.org/?v=2.3.3 By: perrygeo http://www.perrygeo.net/wordpress/?p=82#comment-33735 perrygeo Thu, 20 Sep 2007 00:31:44 +0000 http://www.perrygeo.net/wordpress/?p=82#comment-33735 Well, C/C++, C#/.NET, python, perl, ruby and java are really the only languages that have the libraries I need in the geospatial realm. And they're all adequate at best with regards to concurrency. Personally, I think that threads and shared memory are not the best way to go so I'm looking at a message-passing paradigm. Unfortunately Erlang and other functional languages that excel at this type of concurrency have very little ability to process spatial data sources. MPI looks good as well though it is not quite as easy to set up as I would hope. PP really shines at ease of installation which is a must if you're going to distribute the apps to less technically-oriented users. EC2 looks like a neat option to try this out. If I get some free time, I'll have to try it out! Well, C/C++, C#/.NET, python, perl, ruby and java are really the only languages that have the libraries I need in the geospatial realm. And they’re all adequate at best with regards to concurrency. Personally, I think that threads and shared memory are not the best way to go so I’m looking at a message-passing paradigm. Unfortunately Erlang and other functional languages that excel at this type of concurrency have very little ability to process spatial data sources.

MPI looks good as well though it is not quite as easy to set up as I would hope. PP really shines at ease of installation which is a must if you’re going to distribute the apps to less technically-oriented users.

EC2 looks like a neat option to try this out. If I get some free time, I’ll have to try it out!

]]> By: Roger http://www.perrygeo.net/wordpress/?p=82#comment-33726 Roger Wed, 19 Sep 2007 21:12:54 +0000 http://www.perrygeo.net/wordpress/?p=82#comment-33726 If you are using multiple machines, considering using MPI or PVM to distribute the processing. Yeah, there are even Python interfaces (e.g. http://sourceforge.net/projects/pympi/). Trying out Amazon's EC2 Web Services for this is certainly an interesting option. There are *many* possibilities for taking advantage of multi-core/multi-processor computing as long as you keep an open mind and don't restrict yourself to using only Python. If you are using multiple machines, considering using MPI or PVM to distribute the processing. Yeah, there are even Python interfaces (e.g. http://sourceforge.net/projects/pympi/). Trying out Amazon’s EC2 Web Services for this is certainly an interesting option.

There are *many* possibilities for taking advantage of multi-core/multi-processor computing as long as you keep an open mind and don’t restrict yourself to using only Python.

]]> By: Paul Bissett http://www.perrygeo.net/wordpress/?p=82#comment-33704 Paul Bissett Wed, 19 Sep 2007 12:45:37 +0000 http://www.perrygeo.net/wordpress/?p=82#comment-33704 Have you thought of trying Amazon Web Services EC2? Have you thought of trying Amazon Web Services EC2?

]]>