Allwin Ponraj
Data Engineering Manager at Amazon
12.5
Years of Experience
Education
symbiosis institute of management studies, anna university, dakshina bharat hindi prachar sabha
Companies
amazon, amazon, amazon, financial times, bally technologies acquired by scientific games in nov2014, bally technologies acquired by scientific games in nov2014, cognizant, cognizant, cognizant
Reach out to Allwin Ponraj via Email, InMail and SMS drip
by installing Chrome extension
Allwin's contact details
Email (Verified)
allXXXXXXXXXXXXXXXXXXom
Mobile Number
+91XXXXXXXX80
Experience
2021 - Present
amazon
Engineering Manager - Data & Analytics
Leading a cross-functional team of 15+ engineers from 6 different job families (Data, Software development, Business intelligence, Front-end, Data science and Support) to build the world's best analytics products and data infrastructure to provide a compelling value proposition for Amazon digital business stakeholders to seamlessly manage business across formats and marketplaces. Scope of my role covers five broad areas: 1) Define overall data vision and deliver end to end data processing architecture of global Books Org for downstream BI & ML use cases. 2) Own analytics road map for DA digital commerce by identifying key insights in pre & post purchase experience & influence business strategy through surfacing unique metrics. 3) Drive product vision, strategy, execution and GTM efforts of self-service customer analytics product (Internal name: Odyssey) to evangelize & harmonise data across Amazon teams. 4) Establish large scale data governance solutioning via data product (Internal name: Trumpet), which simplifies preventing and handling data quality issues at amazon scale. These 2 data products are used by 100+ amazon teams. 5) Grow the organization through effective hiring, coaching and scaling development teams that are self-organizing loosely coupled; yet highly aligned. My role impacts overall Analytics setup for digital business, indirectly contributes to P&L by driving step changes in measuring the customer impact of our services, gauging the effectiveness of our product offerings, and identifying opportunities/gaps to proactively help our partners improve their key performance indicators (KPIs).
2018 - 2021
amazon
Data Engineer III
• Provided clear, consistent leadership, tactical and technical management while managing all deliverable schedules, specification and resource allocation. • Designed and Implemented complex batch and high frequency/volume streaming analytical pipelines on our petabyte scale data lake to answer unique forward looking questions. • Collaborated with end-users and partner teams and defined the processes needed to achieve operational excellence resulting in 20% drop in tickets/service requests. Provided On-Call Support for the Production Environments.. • Data Governance and Process Automation: Established strong metadata, data lineage and ownership across multi-disciplinary teams • Stand up innovative proof of concepts on Big Data(Ex: Apache Ray) and ML(AWS Sagemaker)platforms and provided recommendations.
2016 - 2018
amazon
Data Engineer II
• Designed and improved the ETL framework with Python Programming Language using Airflow Operators used by 10K+ jobs. • Automated the migration of all the Legacy jobs (>10k) to new Airflow based ETL framework & Redshift tables (~650) data publish into Data Lake (Hadoop Map- reduce jobs) enabling use of new platform 4 months ahead of schedule. • Researched and Evaluated 10+ Big Data compute platforms and set up all required AWS infrastructure (from scratch) to bring data from Central Data Lake into our Data warehouse and vice versa (Apache Spark). • Built Self Service Discovery tools that helps our 100+ data consumers to extract, analyze, and visual data from Central Data Lake. • Modeled and Independently set Amazon specific Infrastructure to extract data from AWS Neptune(Graph DB) using Gremlin Queries and load into Data Lake. Self-Motivated Projects: • Created an Internal Bot, which will connect all the 20+ AWS sources, monitor and automate corrective action. • Created a utility to provide near-real time EMR job’s recommendations related to memory allocation and node size selection for optimal execution resulting in cost efficiency of ~1MM$.
2015 - 2016
financial times
Senior Data Engineer
• Spearheaded a team of 5+ highly skilled technologists to build the next generation of data warehouse in a tightly governed and better-understood structure. • Influenced business teams to produce open data model which increased flexibility and reduced time to market by 75% and opportunity costs. • Designed DB Objects and ETL pipelines to have optimum performance considering the Redshift DB (MPP) architecture and parameters. This reduced CRM data latency enabling more timely communication leading to improved campaign ROI. Technology : Custom ETL Framework, Amazon Redshift, Amazon S3, BIRST, Chartio, Splunk, Stash(Bit Bucket)
2014 - 2015
bally technologies acquired by scientific games in nov2014
Senior Software Analyst
Being the only ETL developer, Accountable for all ETL tasks in the organization. • Authored Single Source of truth datamart model, Proposed new ETL framework and built scalable data pipelines that collects, transforms, loads and curates data from various (Mapics ERP, Agile PLM,Microsoft Navision, Siebel CRM Systems) data sources. Identified the root cause & optimized 50+legacy ETL Refresh Jobs (>100% reduced execution run time) and OLAP database solutions. • Collaborated with multiple cross-functional teams on daily basis to discuss on the BI solutions and provided technical clarification. Automated X+ manual monotonous tasks for Y+business teams. Technology : Microsoft- SSIS, SSRS, SSAS, SQL Server, Oracle Data Integrator (ODI), Oracle 11g,Cognos 10.2
2012 - 2014
bally technologies acquired by scientific games in nov2014
Software Analyst
2012 - 2012
cognizant
Associate-Projects
• As the ‘Innovation Champion’ in the account, conducted 5+ workshops to unlock team’s creative potential. Lead the application development team from offshore. • Implemented new ETL Informatica/ routines as well-made changes to the existing ETL process to accommodate enhancements. Created new Data maps in Informatica Power Exchange with Copybooks and analyzed Mainframe file data in PWX. • Created new Unix Shell Scripts for reformatting of files and as well for auditing, balancing and controlling ETL Routines. • Designed, developed and validated Oracle Warehouse Builder (OWB) 11g packages and PL/SQL procedures. Self-Motivated Projects: • Developed an Automation tool named ‘ALTERA’ for change tracking and auto precision update for fields in Informatica mappings. This tool helped in analyzing > 2k mappings in few minutes. Saved XX person hours across multiple customer projects and recognized by upper management. • Developed an Automation tool named ‘ULTRA’ for preparing Unit Test Case Template from Informatica mappings. This tool helped in preparing > 5k test cases template in few minutes. Saved XX person hours. • Developed an utility named ‘FAQ-File Access using Query’ for data profiling on the delimited files directly. Technology : Informatica Power Center 8.6.1, Informatica Power Exchange 8.6.1, Oracle 11g
2010 - 2012
cognizant
Programmer Analyst
2009 - 2010
cognizant
Programmer Analyst Trainee
Experience
60 Skills
Administrative
agile methodologies
Airflow
Amazon Elastic MapReduce (EMR)
Amazon Web Services (AWS)
analytics
apache
Apache Airflow
Apache Spark
Application Development
architecture
auditing
Automation
Big Data
business intelligence
Business Intelligence (BI)
Coaching
Communication
CRM
Customer Relationship Management (CRM)
Data Engineering
Data Integration
Data Management
Data Pipelines
Data Processing
Data Science
Data Scientist
Data Warehouse
Data Warehousing
Design
Education
Electronics
Extract, Transform, Load (ETL)
Frontend
Healthcare
Hiring
Informatica
infra
Infrastructure
Integration
Leadership
Machine Learning (ML)
Mainframe
Python
Senior Software Engineer
Software Engineer
SQL
sql server
SQL Server Integration Services (SSIS)
SQL Server Reporting Services (SSRS)
SSIS
SSRS
strategy
Team Building
test
test cases
Unix
Vision
Web
Web Services
Education
2010 - 2012
symbiosis institute of management studies
Postgraduate Diploma in Business Administration
Human Resources Management and Services
2005 - 2009
anna university
Bachelor of Engineering (B.E.)
Electrical and Electronics Engineering
1998 - 2002
dakshina bharat hindi prachar sabha
Rashtrabhasha Praveen (equivalent to B.A)
