I wanted to know whether Python supports out-of-order execution of code. I have implemented few programs for linear algebra problems in C++ where compilers support out-of-order execution to minimize CPU idle time due to memory latency (Memory Bandwidth pressure). Many of the commercial and open-source solvers for solving system of equations use gradient descent (Conjugate Gradients) which are written in C++.
Does Python libraries exploit out of order execution to boost performance. I guess numpy and other libraries which are originally written in C are highly optimized with modern HPC concepts but I’ve not encountered out-of-order execution in Python. If anyone knows please share about it.
Thanks.
