Things I Wish They Told Me About Multiprocessing in Python
“Some people, when confronted with a problem, think ‘I know, I’ll use multithreading’. Nothhw tpe yawrve o oblems.” (Eiríkr Åsheim, 2012)
If multithreading is so problematic, though, how do we take advantage of systems with 8, 16, 32, and even thousands, of separate CPUs? When presented with large Data Science and HPC data sets, how to you use all of that lovely CPU power without getting in your own way?
https://www.cloudcity.io/blog/2019/02/27/things-i-wish-they-told-me-about-multiprocessing-in-python/
“Some people, when confronted with a problem, think ‘I know, I’ll use multithreading’. Nothhw tpe yawrve o oblems.” (Eiríkr Åsheim, 2012)
If multithreading is so problematic, though, how do we take advantage of systems with 8, 16, 32, and even thousands, of separate CPUs? When presented with large Data Science and HPC data sets, how to you use all of that lovely CPU power without getting in your own way?
https://www.cloudcity.io/blog/2019/02/27/things-i-wish-they-told-me-about-multiprocessing-in-python/
Cloud City Development
Things I Wish They Told Me About Multiprocessing in Python
Framing the problem
“Some people, when confronted with a problem, think ‘I know, I’ll use multithreading’. Nothhw tpe yawrve o oblems.” (Eiríkr Åsheim, 2012)
If multithreading is so problematic, though, how do we take advantage of systems with 8, 16, 32…
“Some people, when confronted with a problem, think ‘I know, I’ll use multithreading’. Nothhw tpe yawrve o oblems.” (Eiríkr Åsheim, 2012)
If multithreading is so problematic, though, how do we take advantage of systems with 8, 16, 32…
Announcing a new Sponsorship Program for Python Packaging
The Packaging Working Group of the Python Software Foundation is launching an all-new sponsorship program to sustain and improve Python's packaging ecosystem. Funds raised through this program will go directly towards improving the tools that your company uses every day and sustaining the continued operation of the Python Package Index.
https://pyfound.blogspot.com/2020/04/sponsoring-python-packaging.html
The Packaging Working Group of the Python Software Foundation is launching an all-new sponsorship program to sustain and improve Python's packaging ecosystem. Funds raised through this program will go directly towards improving the tools that your company uses every day and sustaining the continued operation of the Python Package Index.
https://pyfound.blogspot.com/2020/04/sponsoring-python-packaging.html
Python Software Foundation Blog
Announcing a new Sponsorship Program for Python Packaging
The Packaging Working Group of the Python Software Foundation is launching an all-new sponsorship program to sustain and improve Py...
What the heck is pyproject.toml?
Recently on Twitter there was a maintainer of a Python project who had a couple of bugs filed against their project due to builds failing (this particular project doesn't provide wheels, only sdists). Eventually it came out that the project was using a pyproject.toml file because that's how you configure Black and not for any other purpose.
https://snarky.ca/what-the-heck-is-pyproject-toml/
Recently on Twitter there was a maintainer of a Python project who had a couple of bugs filed against their project due to builds failing (this particular project doesn't provide wheels, only sdists). Eventually it came out that the project was using a pyproject.toml file because that's how you configure Black and not for any other purpose.
https://snarky.ca/what-the-heck-is-pyproject-toml/
Tall, Snarky Canadian
What the heck is pyproject.toml?
Recently on Twitter there was a maintainer of a Python project who had a couple
of bugs filed against their project due to builds failing (this particular
project doesn't provide wheels, only sdists). Eventually it came out that the
project was using a pyproject.toml…
of bugs filed against their project due to builds failing (this particular
project doesn't provide wheels, only sdists). Eventually it came out that the
project was using a pyproject.toml…
Your configs suck? Try a real programming language
In this post, I'll try to explain why I find most config formats frustrating to use and suggest that using a real programming language (i.e. general purpose one, like Python) is often (but not always) a feasible and more pleasant alternative for writing configs.
https://beepb00p.xyz/configs-suck.html
In this post, I'll try to explain why I find most config formats frustrating to use and suggest that using a real programming language (i.e. general purpose one, like Python) is often (but not always) a feasible and more pleasant alternative for writing configs.
https://beepb00p.xyz/configs-suck.html
beepb00p.xyz
Your configs suck? Try a real programming language. | beepb00p
Or yet another rant about YAML
Accelerating Python for Exotic Option Pricing
In finance, computation efficiency can be directly converted to trading profits sometimes. Quants are facing the challenges of trading off research efficiency with computation efficiency. Using Python can produce succinct research codes, which improves research efficiency. However, vanilla Python code is known to be slow and not suitable for production. In this post, I explore how to use Python GPU libraries to achieve the state-of-the-art performance in the domain of exotic option pricing.
https://devblogs.nvidia.com/accelerating-python-for-exotic-option-pricing/
In finance, computation efficiency can be directly converted to trading profits sometimes. Quants are facing the challenges of trading off research efficiency with computation efficiency. Using Python can produce succinct research codes, which improves research efficiency. However, vanilla Python code is known to be slow and not suitable for production. In this post, I explore how to use Python GPU libraries to achieve the state-of-the-art performance in the domain of exotic option pricing.
https://devblogs.nvidia.com/accelerating-python-for-exotic-option-pricing/
NVIDIA Developer Blog
Accelerating Python for Exotic Option Pricing | NVIDIA Developer Blog
In finance, computation efficiency can be directly converted to trading profits sometimes. Quants are facing the challenges of trading off research efficiency with computation efficiency.
Reworking StringIO concatenation in Python
Python string objects are immutable, so changing the value of a string requires that a new string object be created with the new value. That is fairly well-understood within the community, but there are some "anti-patterns" that arise; it is pretty common for new users to build up a longer string by repeatedly concatenating to the end of the "same" string
https://lwn.net/Articles/816415/
Python string objects are immutable, so changing the value of a string requires that a new string object be created with the new value. That is fairly well-understood within the community, but there are some "anti-patterns" that arise; it is pretty common for new users to build up a longer string by repeatedly concatenating to the end of the "same" string
https://lwn.net/Articles/816415/
lwn.net
Reworking StringIO concatenation in Python
Python string objects are immutable, so changing the value of a string
requires that a new string object be created with the new value. That is
fairly well-understood within the community, but there are some
"anti-patterns" that arise; it is pretty common…
requires that a new string object be created with the new value. That is
fairly well-understood within the community, but there are some
"anti-patterns" that arise; it is pretty common…
3 Python templating languages you should (probably) never use
Python has accumulated a lot of templating languages, including these three that are perfect for April Fools' Day.
https://opensource.com/article/20/4/python-templating-languages
Python has accumulated a lot of templating languages, including these three that are perfect for April Fools' Day.
https://opensource.com/article/20/4/python-templating-languages
Opensource.com
3 Python templating languages you should (probably) never use
When reaching for a templating language for writing a Python web application, there are an abundance of robust solutio
Episode 3: Effective Python and Python at Google Scale
In this episode, Christopher interviews Brett Slatkin about the 2nd edition of his book Effective Python. Brett talks about the revisions he made for the book, and updating it for the newest versions of Python 3.
https://realpython.com/podcasts/rpp/3/
In this episode, Christopher interviews Brett Slatkin about the 2nd edition of his book Effective Python. Brett talks about the revisions he made for the book, and updating it for the newest versions of Python 3.
https://realpython.com/podcasts/rpp/3/
Realpython
Episode #3: Effective Python and Python at Google Scale – The Real Python Podcast
Have you been using Python for a while, but want to be more effective with your code? This week we have Brett Slatkin on the show. We talk about the 2nd edition of his book Effective Python.
Linked Lists in Python: An Introduction
Linked lists are like a lesser-known cousin of lists. They’re not as popular or as cool, and you might not even remember them from your algorithms class. But in the right context, they can really shine.
https://realpython.com/linked-lists-python/
Linked lists are like a lesser-known cousin of lists. They’re not as popular or as cool, and you might not even remember them from your algorithms class. But in the right context, they can really shine.
https://realpython.com/linked-lists-python/
Realpython
Linked Lists in Python: An Introduction – Real Python
In this article, you'll learn what linked lists are and when to use them, such as when you want to implement queues, stacks, or graphs. You'll also learn how to use collections.deque to improve the performance of your linked lists and how to implement linked…
The Clean Architecture in Python. How to write testable and flexible code
If someone asked about the features of an ideal project, responses would surely mention a few specific things. First of all, an ideal project would have a clean codebase that is simple to read. Secondly, there should be high test coverage to ensure that the project works as expected. What is more, one will instantly know if they broke something thanks to an extensive suite of automated tests. Last, but not least – technical debt should be kept at bay to not pose a threat of lowering a team’s velocity. I bet you already see how enjoyable would be to work on such a project! Unfortunately, software like this is a real rarity. Time to change it.
https://breadcrumbscollector.tech/the-clean-architecture-in-python-how-to-write-testable-and-flexible-code/
If someone asked about the features of an ideal project, responses would surely mention a few specific things. First of all, an ideal project would have a clean codebase that is simple to read. Secondly, there should be high test coverage to ensure that the project works as expected. What is more, one will instantly know if they broke something thanks to an extensive suite of automated tests. Last, but not least – technical debt should be kept at bay to not pose a threat of lowering a team’s velocity. I bet you already see how enjoyable would be to work on such a project! Unfortunately, software like this is a real rarity. Time to change it.
https://breadcrumbscollector.tech/the-clean-architecture-in-python-how-to-write-testable-and-flexible-code/
breadcrumbs collector.tech
The Clean Architecture in Python. How to write testable and flexible code
(Hey! This article is almost 2 years old :) Look here for something about the Clean Archictecture in 2021) An ideal project? If someone asked about the features of an ideal project, responses would surely mention a few specific things. First of all, an ideal…
How to Make an Instagram Bot With Python and InstaPy
What do SocialCaptain, Kicksta, Instavast, and many other companies have in common? They all help you reach a greater audience, gain more followers, and get more likes on Instagram while you hardly lift a finger. They do it all through automation, and people pay them a good deal of money for it. But you can do the same thing—for free—using InstaPy!
https://realpython.com/instagram-bot-python-instapy/
What do SocialCaptain, Kicksta, Instavast, and many other companies have in common? They all help you reach a greater audience, gain more followers, and get more likes on Instagram while you hardly lift a finger. They do it all through automation, and people pay them a good deal of money for it. But you can do the same thing—for free—using InstaPy!
https://realpython.com/instagram-bot-python-instapy/
Realpython
How to Make an Instagram Bot With Python and InstaPy – Real Python
In this step-by-step tutorial, you'll learn all about how to use InstaPy to create an Instagram bot that can increase your follower and like count with minimal effort on your end. Along the way, you'll also learn about two tools that InstaPy uses under the…