Web Scraping Social Media Profiles X, Instagram, Tiktok, Youtube

Hi everyone!

I’ve created a noscript for scraping public social media accounts for work purposes. I’ve wrapped it up, formatted it, and created a repository for anyone who wants to use it.

# What My Project Does
The main focus of this project is to scrape data from profiles and their posts. For example:
- In my job, I’ve automated it to run daily for our social media profiles, storing the data for later analysis.
- A firend of mine wanted to download all the thumbnails of a youtube channel.

# How it works
The noscript uses Playwright to intercept requests and clean up the data. It also includes a second part that converts images to Base64 encoding, which is useful when image URLs expire or cannot be displayed directly in an HTML img tag. For YouTube, it uses the API v3, as it's straightforward to obtain an API key.

I believe the noscript is easy to use, and you can quickly adapt it to suit your needs. Be sure to check out the README for more details!

# Target Audience
This tool is for anyone who needs to scrape social media data. The code is simple enough to copy, modify, and integrate into your project.

# Comparison
I haven’t extensively

/r/Python
https://redd.it/1h2o2n5

Saturday Daily Thread: Resource Request and Sharing! Daily Thread

# Weekly Thread: Resource Request and Sharing 📚

Stumbled upon a useful Python resource? Or are you looking for a guide on a specific topic? Welcome to the Resource Request and Sharing thread!

## How it Works:

1. Request: Can't find a resource on a particular topic? Ask here!
2. Share: Found something useful? Share it with the community.
3. Review: Give or get opinions on Python resources you've used.

## Guidelines:

Please include the type of resource (e.g., book, video, article) and the topic.
Always be respectful when reviewing someone else's shared resource.

## Example Shares:

1. Book: "Fluent Python" \- Great for understanding Pythonic idioms.
2. Video: Python Data Structures \- Excellent overview of Python's built-in data structures.
3. Article: Understanding Python Decorators \- A deep dive into decorators.

## Example Requests:

1. Looking for: Video tutorials on web scraping with Python.
2. Need: Book recommendations for Python machine learning.

Share the knowledge, enrich the community. Happy learning! 🌟

/r/Python
https://redd.it/1h2zjp4

People who have styled/modified the admin page, how did that go?

In terms of difficulty, how bad was it? especially if you had to style it. and was it worth it?

/r/django
https://redd.it/1h2ybk4

Short-Circuiting in Python

Here is my article on Short-Circuiting in Python . It discusses what is short-circuiting with examples, and also discusses the different advantages of using short-circuiting.

/r/Python
https://redd.it/1h30nsp

Google OAuth, Grok Api, Cloudinary not working properly.

Basically, i have two same django projects with same files. One project is deployed in Render and other is deployed in Railway. The Google OAuth, Grok Api, Cloudinary( for handling media files) are working in Render deployed project but not in Railway deployed project. What could be the issues? I have included all the libraries and changed some of the settings, links but even then it is not working. Can anyone help me out!

/r/djangolearning
https://redd.it/1h24ukq

A tutorial on how to create Web Apps using only Python

Hey everyone! I created an hour-long tutorial on creating a Web App using only Python with Taipy, an open-source Python library. It covers visual elements, interactions, styling, multiple pages, and it touches on authentication and deployment.

Feel free to take a look here:
https://youtu.be/4F-266YnTkM?si=qGDra6c68\_jz6ZBK

/r/Python
https://redd.it/1h32v2g

Domain Driven Design in Python

Hi,

I'm recently building a hobby project backend which uses domain driven design and clean/hexagonal architecture. I'm pretty new to domain driven design, so I'm reading about it and trying to implement it. I'm using google and perplexity to get understand the concepts, clear my doubts and get different perspectives when trying to make a choice between multiple implementations. Now, I'm looking for a open-source project that makes heavy use of DDD implementing things like event sourcing, etc so I can get a better understanding of the implementation. Does anyone know any good github repos which implements Domain driven design which I can use as reference?

/r/flask
https://redd.it/1h377gf

How to host a flask app with https on home server

Im doing a learning project trying to set up a flask app with https on my home network and make it available online. Im using a asus router and set up ddns with a asus provided domain name and port forwarding. This part works with http.

How would i go about making this work with https. In the asus router settings for ddns i have generated key and cert.pem from letscencrypt (for the domain i guess?) But how can i configure the flask app to use this?

/r/flask
https://redd.it/1h10py6

Tech Events @ Europe

In the repository https://github.com/ortolanph/tech-events-europe there is a listing of events for Europe for this year (I know that's only Portugal, but this is what I have done for now). If you want to contribute to next year's event, just follow the rules on the site.

Thanks!

/r/Python
https://redd.it/1h3bhgl

Flask with HTMX Example

Thanks to the holidays I've managed to find the time to get heads down with learning a few new things and I'm sharing this latest example of converting the Flask blog tutorial project into a single page application with HTMX.

This was more challenging than I thought it would be, mostly because my templates became increasingly more difficult to read as time passed. This example could be cleaned up more with the use of macros, but I thought it would be best to keep most of the original code intact to compare this with the source example better.

My biggest takeaway from this project was the concept of out-of-band swaps for updating other parts of the HTML outside of the original target.

HTMX is a great tool and I'm happy to see it getting more traction.

/r/flask
https://redd.it/1h3dlmt

Jupyter Lab vs Notebook

I'm working in AWS SageMaker doing my analyses using Jupyter in an EC2 instance/in the cloud. I had been using JupyterLab for a bit now, but I've been noticing that when I close out of my tabs, my Jupyter processes end as well. I tested the same with regular notebooks/Jupyter, and those processes stay active even when I close my tabs. Is this to be expected, and is there a way to keep JupyterLab running even after closing my tabs? I'm not sure if working in SageMaker/the cloud makes a difference to working locally

/r/IPython
https://redd.it/1h3jg6e

Django and Postgres for the Busy Rails Developer
https://andyatkinson.com/django-python-postgres-busy-rails-developer

/r/django
https://redd.it/1h3c1un

D Modern use-cases for RNNs?

The discussion can be twofold.
1)What are in your opinion some tasks, for the personal projects scale, where you think RNNs close to traditional implementations (LSTM, GRU) are still the best starting and ending point? Especially compared to transformers.

In small time-series forecasting settings I can see a GRU being more convenient than a Transformer probably, but I am interested also in tasks where inputs are sequences of symbols or measures, but outputs maybe not.

The main goal is to play with LSTM and GRU variants (eg minGRU) on datasets where it makes sense, might do tiny-Shakespeare but it doesn't warm my heart...

2) do you think there are sequential tasks and settings where RNNs are not only the more natural option according to our intuition, but actually the only theoretically or experimentally available option to make do, compared to Transformers or 1D CNNs etc?

/r/MachineLearning
https://redd.it/1h38ym2

I need help with using aiortc with flask.

I was hoping someone could help me, I am new to flask. I am trying to implement a webrtc stream for a one way CCTV/rtsp monitoring system. I chose flask because I am using computer vision for security and also training and/or deploying AI models was the goal for this project. I just can’t find a project anywhere or get any type of AI to help me properly configure it all to work for one way, server to client streaming. I am also a newb to programming, just a hobbyist. Right now my repo is private because I have personal info in some of my code that could cause vulnerabilities, that I do not want to share. But I was wondering if anybody out there has a public repo that was good for one way WebRTC streaming and that actually functions. I’m not trying to video and voice chat, just view a security camera’s stream. I had it working with HTTP but it was absolutely horrible frame quality. It was like slow motion and you had to refresh the page. So I want to try WebRTC so freaking bad lol. I guess I could ditch flask for something else but

/r/flask
https://redd.it/1h3ghxi

Sunday Daily Thread: What's everyone working on this week?

# Weekly Thread: What's Everyone Working On This Week? 🛠️

Hello /r/Python! It's time to share what you've been working on! Whether it's a work-in-progress, a completed masterpiece, or just a rough idea, let us know what you're up to!

## How it Works:

1. Show & Tell: Share your current projects, completed works, or future ideas.
2. Discuss: Get feedback, find collaborators, or just chat about your project.
3. Inspire: Your project might inspire someone else, just as you might get inspired here.

## Guidelines:

Feel free to include as many details as you'd like. Code snippets, screenshots, and links are all welcome.
Whether it's your job, your hobby, or your passion project, all Python-related work is welcome here.

## Example Shares:

1. Machine Learning Model: Working on a ML model to predict stock prices. Just cracked a 90% accuracy rate!
2. Web Scraping: Built a noscript to scrape and analyze news articles. It's helped me understand media bias better.
3. Automation: Automated my home lighting with Python and Raspberry Pi. My life has never been easier!

Let's build and grow together! Share your journey and learn from others. Happy coding! 🌟

/r/Python
https://redd.it/1h3q203

Smilestone 😃

MVP deployed. React-django-mysql. So fckn proud of myself!

/r/djangolearning
https://redd.it/1h35n7f

Looking for Beginner-Friendly Flask Project Ideas


Hi everyone,

I’m new to Flask and want to work on some beginner-friendly projects that can help me improve my skills while staying manageable for a learner.

I’d appreciate any suggestions for projects that:

Cover basic Flask features like routing, templates, and forms.

Are practical or fun to build and learn from.

Can be expanded with additional features as I progress.


Thanks a lot for your ideas and guidance!💗


/r/flask
https://redd.it/1h3fabe

Protocols vs Abstract Base Classes in Python

Hi everyone. Last time I shared a post about Interface programming using abs in Python, and it got a lot of positive feedback—thank you!

Several people mentioned protocols, so I wrote a new article exploring that topic. In it, I compare protocols with abstract base classes and share my thoughts and experiences with both. You can check it out here: https://www.tk1s.com/python/protocols-vs-abstract-base-classes-in-python Hope you'll like it! Thanks!

/r/Python
https://redd.it/1h3rmn5

Big Tech Best Practices

I'm working at small startup, we are using FastAPI, SQLAlchemy, Pydantic, Postgres for backend
I was wondering what practices do people in FAANG use when building production API
Code organization, tests structure, data factories, session managing, error handling, logging etc

I found this repo https://github.com/zhanymkanov/fastapi-best-practices and it gave me some insights but I want more

Please share practices from your company if you think they worth to share

/r/Python
https://redd.it/1h3jize

Multi-Threading in Python and Free threaded Python 3.13

Here is my article Multi-Threading in Python and Free threaded Python 3.13 which discuss multi threading in Python and some experiments on free threaded Python 3.13.

#

/r/Python
https://redd.it/1h3wd80

Is Django an overkill for a Landing page?

Client asked me to deliver a Landing page. It will be a promo page with animations and GSAP scroll triggers. With a slight functionality of a TikTok API.

I don't know React well enough to build this solely on it, so I though of me using Django, because I'm familiar with it. I know it might sound like an over kill... but maybe not?

Any thoughts?

Thanks!

/r/django
https://redd.it/1h3u3yh