Numpy/Pandas performance links
http://numba.pydata.org/ A faster alternative to Pandas isin function Pandas performance Pandas iterrows alternatives (performance issues)
Category: Python
Python profiling links (memory and CPU)
Tools: Tracemalloc, memory_profiler, meliae (Python 2 only), Pympler Built-in modules: gc Links: Python Memory Issues: Tips and Tricks Muppy toturial Debugging with Tracemalloc Using profilers – the basics Py-spy – top-like live view… Read more »
Generator Context Manager Pitfall
Consider the following context manager: The following code with print ‘bla’ between ENTERED and EXITED but will also raise the exception: That’s what I would expect from a context manager… Read more »
Lazy Logging – a Performance Story
Why Lazy Logging and my solution While debugging some issue I needed to get more details about an object. Generating this information meant combining some fields, getting length of some… Read more »
Decorators for assisting in debugging Python code
WARNING: The following decorators are NOT production grade, not thoroughly tested and should only be used for debugging. I am aware that as far as decorators, they are not perfect… Read more »
Nested/Double-iteration in List Comprehension
Goal I was trying to transform the following structure: The format is such that each value (rows_by_category[‘a’]) is a list of rows, where the first row is the header, and… Read more »
Between Iterators and Iterables – How and Why?
Python provides two different but related protocols called an iterator and iterable. The Python Practice Book provides a good explanation, including complete examples. I highly recommend reading it and then… Read more »