Intel Offers Additional Performance for Multi-Threaded Python Programs
Tuesday, April 12, 2016
In its beta release of Intel Distribution for Python, Intel is introducing what they call “something new and unusual for the Python world.” The new functionality is an experimental module which unlocks additional performance for multi-threaded Python programs by enabling threading composability between two or more thread-enabled libraries.
The Intel Distribution for Python platform promises to offer faster performance from Python packages powered by Intel Math Kernel Library (Intel MKL). The beta product adds new Python packages like scikit-learn, mpi4py, numba, conda, tbb (Python interfaces to Intel Threading Building Blocks) and pyDAAL (Python interfaces to Intel Data Analytics Acceleration Library). The platform also delivers performance improvements for NumPy/SciPy through linking with performance libraries like Intel MKL, Intel Message Passing Interface (Intel MPI), Intel TBB and Intel DAAL.
With the new ability of threading composability, developers can accelerate programs by avoiding inefficient threads allocation (oversubscription) when there are more software threads than available hardware resources.
Intel says the biggest improvement is achieved when a task pool like the ThreadPool from standard library or libraries like Dask or Joblib (used in multi-threading mode) execute tasks calling compute-intensive functions of Numpy/Scipy/PyDAAL which in turn are parallelized using Intel MKL or/and Intel Threading Building Blocks (Intel TBB).
The module implements Pool class with the standard interface using Intel TBB which can be used to replace Python’s ThreadPool. With the monkey-patching technique implemented in class Monkey, no source code change is needed in order to unlock additional speedups.
Read more: https://software.intel.com/en-us/blogs/2016/04/04/...
Use quantum computers over the cloud with ACQUA Friday, June 15, 2018
Karaoke singing app gets updated Thursday, June 14, 2018
The dating app for dog lovers launching in 25 cities Thursday, June 14, 2018
Companies plan to invest in DataOps new survey finds Thursday, June 14, 2018
What American companies can learn from Europe's new GDPR laws Wednesday, June 13, 2018
Stay UpdatedSign up for our newsletter for the headlines delivered to you