Introduction Cloudflare’s Captcha solutions are one of the biggest hurdles Python developers usually face while writing a web scraper. Cloudflare offers various solutions like bot detection, CAPTCHA challenges (including the newer Turnstile verification), and IP blocking to prevent automated website access for data retrieval. These protections often result in “Verify You Are Human” checks, 403 Forbidden errors, or the challenging 1020 Access Denied responses. In this post of the scraper series, we will learn about Cloudflare and its service that hinders web scraping and how you can use ScraperAPI’s APIs to bypass Cloudflare’s CAPTCHA/protection techniques. Understanding Cloudflare Protection What is Cloudflare? A global network service provider that offers website security,…
-
-
Build a Crypto Bot Using OpenAI Function Calling
This post is part of the GenAI Series. In the previous post of the GenAI series, I built an adaptive dashboard using Claude APIs. In this post, I’ll introduce the concept of function calling and show how we can leverage it to build a crypto assistant that generates RSI-based signals by analyzing OHLC data from Binance. What is function calling Function calling in OpenAI’s API lets the model identify when to call specific functions based on user input by generating a structured JSON object with the necessary parameters. This creates a bridge between conversational AI and external tools or services, allowing your crypto bot to perform operations like checking prices or…
-
Detecting the Engulfing Pattern Using pandas-ta
This post is part of the T4p Series. In the previous post, I discussed the Hammer Pattern. So far, we have been writing everything from scratch to detect a certain pattern. However, there’s an amazing library available that has done all the heavy lifting on our behalf and provides easy-to-use interfaces to detect patterns. I will be using the pandas-ta library for this purpose. For certain patterns, it relies on the TA-Lib library, a C++ library for technical analysis. What Is The Engulfing Pattern The Engulfing Pattern is a two-candle pattern that hints at a possible reversal in price direction. It consists of two candlesticks: Bullish Engulfing Pattern: This pattern shows up when prices…
-
Create an Adaptive Customer Behavior Analytics Dashboard with Claude AI and Python
This post is part of the GenAI Series. In my previous post, I introduced OpenAI’s image APIs and used them to create avatars. Today, I’m diving into another LLM service, ClaudeAI, which has gained traction for its speed and sharp analytical responses. I asked Claude to brainstorm ideas for my next blog post about itself. Among many fantastic suggestions, I chose Customer Behavior Analysis. Finding a suitable dataset on Kaggle was easy, but the real challenge began when I started working on it. I didn’t expect it to take 4–5 hours to achieve my goal. Initially, I had no clear idea how to use Claude for this, but Claude itself guided…
-
Illness Is a Form of Meditation
Last night, I started feeling unwell during a company meeting. As the meeting progressed, I felt cold and began shivering. By the time it ended, the shivering had intensified. Even with socks on, I couldn’t warm up. I went to bed around 2 a.m. but had to get up multiple times to use the bathroom. I didn’t want to disturb my wife, but eventually, I needed medicine. She gave me Panadol and some biscuits, which I ate before taking the medicine. After that, I finally slept. In the morning, I still felt weak, though I didn’t have a fever. After breakfast, I remained in bed, lacking the energy to do…
-
Build Your Web Scraper with Crawlbase in Python: A Beginner’s Guide
If you’ve ever felt curious about collecting data straight from websites—but instantly thought, “This sounds way too complicated!”—then you’re in for a treat. Web scraping, contrary to popular belief, can be simple, efficient, and even fun… especially if you have the right tools in your arsenal. With just a few lines of Python code and an amazing third-party service like Crawlbase, you can automate the collection of information from the web while bypassing the usual challenges (think CAPTCHA, IP blocks, JavaScript-heavy sites, and more). In this guide, I’m going to walk you step-by-step through the process of building your first web scraper with Python using Crawlbase. By the end, you’ll…
-
Detecting the Hammer Candlestick Pattern Using Python
This post is part of the T4p Series. In the previous post, we discussed creating your custom signal generation pattern. In this post, we will discuss a famous candlestick pattern called the Hammer pattern. We will discuss the pattern, what it is all about, and how it helps traders to earn money. Introduction A Hammer is a single candlestick pattern that forms during a downtrend and is characterized by having a small real body at the top of the candle, a long lower shadow (at least 2-3 times the size of the body), and little to no upper shadow. The pattern indicates a potential trend reversal as it shows that despite…
-
Generate Stunning Avatars Using OpenAI APIs
This post is part of the GenAI Series. So far in the series, we have created AI apps that generate text. In this post, I will introduce OpenAI’s image generation APIs, which can convert a textual prompt into an image and perform many other tasks related to images. I am going to make an app called AvatarAI. It will generate an avatar based on different parameters. Avatars are very common in the digital world. People use them mainly as profile pictures for forums, depicting their digital version. In case you are just interested in watching the demo, you can see it below: Prompt Engineering Like before, we will first create a prompt that…
-
Amazon Scraper: Get ANY Product Data from Amazon without coding
As the world’s leading e-commerce platform, Amazon not only provides consumers with a seamless and reliable one-stop shopping experience but also serves as a critical data aggregation hub. Its vast repository of product information enables sellers to perform in-depth market research and develop effective sales strategies. How to integrate a substantial amount of data in a structured way to give your e-commerce business a real leg up? It is not a smart move to manually search, paste, and copy the required information directly; while using code for web scraping poses a technical barrier for people lacking a programming background. Fortunately, there is a user-friendly intelligent web scraper available that can…
-
Design Custom Candlestick Patterns for Signal Generation Using Python
This post is part of the T4p Series. In the previous post, I introduced you to Candlestick patterns, explaining what they are and discussing a couple of well-known patterns and their implementation in Python. We will be discussing further famous patterns in coming posts but here we will learn how you can come up with your own candlestick patterns and implement them in Python. Ultimately, we will be using our custom and awesome candlestick pattern to generate signals and print money. Custom Pattern So, what would that custom pattern be? Pretty simple: Bullish: If 3 consecutive candles are green, it triggers a SELL signal. Bearish: If 3 consecutive candles are red, it…
