![Profile](https://weekday-user-pictures.s3.ap-south-1.amazonaws.com/profile-images/default.jpeg)
Ali Rizvi
Seeking Internship Opportunities For Summer 2022 | CS Graduate | Creative aspiring Data Scientist with 5 years of experience
5.3
Years of Experience
Education
illinois institute of technology, amity university
Companies
saama, blazeclan, accenture, puresoftware, 3 embed
Reach out to Ali Rizvi via Email, InMail and SMS drip
by installing Chrome extension
Ali's contact details
Email (Verified)
aliXXXXXXXXXXXXXXXXXXom
Mobile Number
+91XXXXXXXX93
Experience
2021 - 2021
saama
Pyspark AWS Data Engineer
In this short span of time, I advanced my big data concepts and technologies. Worked independently on various modules to ingest and migrate gigabytes of data on AWS cloud. Roles and Responsibilities: - As a Big Data Engineer, managed to ingest, validate, and transform program files in end to end data pipeline on AWS. - Wrote pyspark scripts to apply hard quality checks on data at record level to generate reports for end users. - Wrote data flow wrappers to automate the ETL process through AWS Apache Airflow.
2018 - 2021
blazeclan
Cloud Engineer
Worked as a Cloud Data Engineer in various projects for creating datalake, datawarehouse, datamodel, dataapplications, and also datamigration to cloud. Roles and Responsibilities:- PROJECT #1 – Data Migration to Cloud for an Indian Department Store Chain Company - As a Big Data Engineer, managed to implement performance-optimized and innovative big data-driven framework/solutions using Apache Spark(SCALA) on AWS EMR. - Wrote complex SQL queries with aggregations to derive data from various tables and transform the output with the principles of DATA WAREHOUSING - Wrote data flow wrappers to automate the ETL process through APACHE AIRFLOW PROJECT #2 – Web/Mobile Application Development for Insurance based Company - Developed application development pipelines from REST and WEBSOCKET APIs of AWS API GATEWAY for storing - synchronous, asynchronous, and real-time data, to NoSQL databases like – CASSANDRA and DYNAMODB. - Developed real-time data reporting dashboards for higher management people to see the daily activities of their reportees using AWS CLOUDWATCH, LAMBDA, FARGATE ECS DOCKER, EC2, S3, DYNAMODB, API GATEWAY. - Developed OTP verification and validation generic journey and other related modules using python scripts on serverless compute – AWS Lambda and AWS PINPOINT PROJECT #3 - Data Lake and Recommendation Engine for a Malaysian Telecom Company - Developed Python scripts for different data sources to perform ETL process using AWS LAMBDA - Priorities all ETL jobs to execute more robustly using AWS STEP FUNCTIONS - Developed recommendation engine, based on past historical purchased data of telecom products, using various classical statistical, Machine Learning algorithms. Project #4 - Data Lake for an Indian Chemical Industry - Developed 50 automated jobs for processing data using TALEND and dumped in AWS REDSHIFT which helped this customer to automate approx. 40 dashboards for migration from MS-Excel to the QlikSense-Visualization tool
2016 - 2018
accenture
Application Development Analyst
Worked as a back-end Java/Python developer for one of the largest British Bank project in which we helped customers to credit the amount of given cheque in their accounts by clicking the image of it. Roles and Responsibilities: - Developed micro-service components for clearing debit and credit transactions after analyzing the requirements from CONFLUENCE user stories. - Defined the APACHE CAMEL routes for end-to-end orchestration in the pipeline and for communicating various micro-services in the application. These routes were annotated by JAVA SPRING MVC. - Developed ample contract virtual stubs based on RESTful API for testing the component in a very early stage. - Developed generic JAVA model classes which could be used in many components. Also, was a part of many interfaces within the project to achieve abstraction. - One and only responsible to develop a Hybrid (Keyword + Data + Modular) driven Automation Framework from its initial stage. I was the owner of the entire customized PYTHON library which helped manual testers to validate the data from XML, JSON, HTML files and generated the reports in Spreadsheets. - Experience in SQL queries for validating data from the database using DML, DDL statements. - Configured the deployment of the same automation framework on a continuous integration tool called JENKINS, integrated with GITS, for accomplishing the testing smoothly and on different environments of the project. - Developed beautiful line, bar, pie graphs, and dashboards on Data Analytics tool called KIBANA with the help of Elastic Search and Logstash
2015 - 2015
puresoftware
Associate Software Engineer
2013 - 2013
3 embed
Android Development Intern
Experience
85 Skills
Airflow
Algorithms
Amazon Athena
Amazon Dynamodb
Amazon Elastic MapReduce (EMR)
Amazon Redshift
Amazon S3
Amazon Simple Notification Service (SNS)
Amazon Web Services (AWS)
analytics
apache
Apache Airflow
Apache Camel
Apache Spark
Application Development
Application Programming Interfaces (API)
Automation
AWS Lambda
Backend
Big Data
Cassandra
CI/CD
Cloud Computing
Communication
Confluence
Continuous Integration
Data Analytics
Data Engineering
Data Migration
Data Modeling
Data Science
Data Scientist
Data Warehouse
Data Warehousing
DevOps
Docker
ECS
Elastic Search
Excel
Extract, Transform, Load (ETL)
finance
GitHub
Google Cloud Platform (GCP)
html
Integration
Java
Jenkins
JSON
Kibana
LESS
linux
Logstash
Machine Learning (ML)
Microservices
Mobile
Mobile Application Development
Model-View-Controller (MVC)
MVC
MySQL
NoSQL
Pandas
Pandas (Software)
Perl
pyspark
Python
QA Automation
quality assurance (QA)
Representational State Transfer (REST)
Research Scientist
REST
Search
Selenium
Service-Oriented Architecture (SOA)
SOA
Spring
Spring MVC
SQL
strategy
test
testing
Web
WebSocket
Windows
windows 7
xml
Education
2021 - 2023
illinois institute of technology
Master of Science - MS
Computer Science
2011 - 2015
amity university
Bachelor of Technology (B.Tech.)
Computer Science