Source

In my last blog, I talked about errors in SQL Server and the methods used to handle them. In this blog, I will talk more about how SQL transactions works. This blog is a continuation of information from DataCamp’s “Transactions and Error Handling in SQL Server” course. The data used for the concepts in this blog is a bank account transaction dataset, containing information from customers, accounts, and transactions.

Transactions

The definition of a transaction is the execution of one or more operations, such that either all or none of the operations are executed. An example of transaction using our dataset…

In my previous blog, I talked about how I wanted to develop certain aspects of my SQL skills. One such aspect that I wanted to learn more about was how to handle errors when performing SQL scripts. There may be instances upon running a SQL script that it may not execute properly and it is important to understand why this occur and how to debug this.

In this blog, I will talk about error handling in SQL using information from DataCamp’s “Transactions and Error Handling in SQL Server” course. …

For my blog this week, I wanted to shift gears towards developing my SQL skills further. One of the topics that I wanted to focus on was how to work with messy data and how to properly clean it. Maintaining clean data is an essential part of the data science process. It allows for easy navigation and exploration of the data for further analysis.

In order to learn more about how data cleaning is done in SQL, I took DataCamp’s “Cleaning Data in SQL Server Databases” course. In the course, I learned how to deal with improper string values, missing…

Microsoft Power BI is a data visualization tool that allows its users to create visualizations, reports, and dashboards. It is one of, if not the most commonly used data visualization tool for business intelligence and possesses a large market share among Fortune 500 companies. In preparation for an upcoming job opportunity, I completed Datacamp’s “Introduction to Power BI” course to get more familiar with how it works.

Introduction:

Power BI is available for use in two ways: Desktop and Service. Desktop is the version that is accessible through your local computer. It is free to use and includes many features such…

For the final part of my blog series on AWS Boto3, I decided to take a more in-depth look at AWS Comprehend. Comprehend is a Natural Language Processing(NLP) tool that is used to find and understand sentiment within text. NLP is an important field within computing as its main concept is to understand and attribute meaning to text. As with Rekognition, Comprehend does not require you to be an expert in machine learning or even NLP in order to use it as it uses a pretrained optimized NLP model to analyze text.

Comprehend has a number of use cases for…

One of the last segments of the course mentioned in these previous blogs was about Amazon Rekognition. Even though it was discussed for merely half of this section, I was fascinated enough by this small tidbit that I wanted to delve deeper into how it works and how it is used.

Amazon Rekognition is a computer vision service that provides for automatic image and video analysis for identifying objects, such as faces or text. Conventional means for identifying objects of interest involves having individuals tediously going through multiple images and is prone to errors and increasing costs. …

Continuing along with the course mentioned in the previous blog, the next part covered notification services using SNS. Simple Notification services or SNS are crucial when dealing with applications or data pipelines. They allow you to reliably send notifications directly to users for monitoring or alerting. In this blog, I will cover how SNS works and is used for SMS and email alerts.

In order to create an SNS topic, you must first initialize a Boto3 client for SNS. Initializing still requires a valid access key id and secret access key. Creating a topic is done by calling the create_topic

In a time where datasets are getting larger and the needs of a business are growing in costs, many have turned to cloud computing as a means to mitigate both of these issues. With this increased interest, it is no wonder that Amazon Web Services (AWS) has become increasingly popular over the past couple of years. Parallel or cloud computing provides a level of flexibility and scalability that allows users or businesses to adjust accordingly to their needs.

AWS has hundreds of services, from cloud storage using S3, notification services with SNS, and even sentiment analysis using Comprehend. Boto3 is…

Continuing along after my first blog on Apache Airflow, the next sections of the course were about using sensors, executors, templates and putting all the information together towards building a production-quality workflow.

Sensors are operators that wait for a specific condition to be true. This can be a condition such as whether a file was created or whether an upload to a database record occurred. In addition to the standard operator attributes, sensors have unique attributes regarded how to check for a condition. Mode determines how the sensor checks for the condition. The default mode is ‘poke’ in which the…

Many companies have been forced to adapt their work organization and structure for their employees working from home due to COVID-19. As a result of this, parallel computing or cloud computing has become much more prevalent due to cost optimization and the fact that certain data centers may not be as easily accessible anymore. In preparation for an upcoming interview, I decided to further my knowledge on the technologies and processes used in data engineering that make this new work structure possible. One such technology that I’ve heard of but have not had a prior chance to work with was…

Michael Flores

Data Science student and aspiring Data Analyst

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store