Creating a bot to automatically check for Amazon Flex delivery slots
Creating a bot to check for Amazon Flex delivery slots automatically requires a combination of web scraping techniques, user authentication, and scheduling mechanisms. Here’s a general overview of the process: Sample script Here is an example of a…
Read More »Parsing Excel formulas in PySpark
This blog shows a couple of examples of how you can use the Spark Excel Library in PySaprk to parse Excel formulas: Example 1 In this example, the code uses the “com.crealytics.spark.excel” library to read an Excel file…
Read More »When it is best to prefer REST over GraphQL
When building web APIs, developers have two main options: REST and GraphQL. Both have their strengths and weaknesses, and the choice between them depends on the specific requirements of your application. In this blog post, we will discuss…
Read More »Quotas and Limitations of Various Managed Kafaka Services
This post contains a comparison of different managed Kafka-enabled message/event processing services available for AWS, Azure and Google Cloud Platform (GCP). I know I need to format this a bit better. Description Azure Event Hub Azure Event Hub…
Read More »Databricks – Connecting to Azure Blob Storage
This post includes a sample iPython Notebook with examples of how one can connect to Azure Blob Storage in Databricks. There are three options discussed: 1. Using the DataFrame API with Access Keys or SAS Keys.2. Mounting on...
Read More »Automate, Schedule and Deploy AMI backups of EBS-Backed EC2 Instances using Lambda, CloudWatch and Terraform
Last week a friend asked for a solution to automatically take backups of their EBS-Backed EC2 instances on AWS. The EC2 instances included a mix of Linux and Windows AMIs.This solution uses an AWS Lambda function written in…
Read More »Analysing UK House Price Data with Spark, Athena and Tableau
A few days back I joined a webinar by the latest Tabelau Iron Viz champion, Tristan Guillevin. Tristan created a dashboard to analyze US housing market using a summarized data set. I decided to replicate it using UK…
Read More »How to Sign HTTP Requests to AWS Data Lake Solution using Python
“AWS offers the data lake solution, which is an automated reference implementation that deploys a highly available, cost-effective data lake architecture on the AWS Cloud along with a user-friendly console for searching and requesting datasets.” (click here for…
Read More »AWS Lambda-backed Custom Resource to deploy tables in Athena via CloudFormation
You can use AWS::Athena::NamedQuery resource to create an Amazon Athena query. However there is no resource that can be used to create a database and table(s). This is where we can make use of Lambda-backed custom resources in a CloudFormation…
Read More »Setup AWS Lightsail with a Route 53 domain
A few days back I decided to revive my old blog hosted on webs.com. I had already transferred the management of my existing domain irtaza.info to Route 53. Initially I had a plan to create a serverless blog…
Read More »
