Allen Han
Data Engineer at Capital One
8.5
Years of Experience
Education
santa clara university leavey school of business, university of california los angeles, university of california los angeles
Companies
capital one, capital one, apple, virtual power systems, virtual power systems, dilili labs, knowledge freeway co., initio corporation
Reach out to Allen Han via Email, InMail and SMS drip
by installing Chrome extension
Allen's contact details
Email (Verified)
allXXXXXXXXXXXXXXom
Experience
2022 - Present
capital one
Data Engineer
Data pipeline with Spark and PySpark on AWS • Scala syntax with DataFrame, Dataset, and Spark SQL APIs • Python syntax with DataFrame and Spark SQL APIs (Databricks) • Deployed on AWS EMR clusters, and triggered by serverless functions scheduled on Eventbridge • Read data from S3 backed storage, and write to S3 backed data lake as part of an ETL process • PostgreSQL for persisting data consumed by batch job
2021 - 2022
capital one
Software Engineer
Scala backend development for financial applications • Monix and ZIO for Kafka streaming • http4s and sttp for client-server communication • Microservices architecture based on Domain-Driven Design • Dependency injection with ZIO layers • Architecture concurrency model uses ZIO fibers and ZIO concurrency primitives • DSL and interpreter for financial transaction processing • DevOps based continuous integration with Jenkinsfile scripted pipelines
2020 - 2021
apple
Scala Spark Software Engineer
Graph-based big data engineering with Apache Spark • Map-reduce style programming with RDD API with Scala to manipulate geographic map data • GraphX and Pregel for message-passing style semantics • Use graph algorithms like graph partitioning and connected components to solve data quality problems at scale • Analytics processing of CSV output with Python and SQLite
2019 - 2020
virtual power systems
Software Engineer - Scala
Scala backend development using the Akka toolkit • Actor model for asynchronous, non-blocking multithreading • REST APIs written with Akka-http and Circe. • Elasticsearch for storing time-series data • Functional programming with type-classes and category theory inspired abstractions • Object-oriented entities for expressing business logic • Implemented graph algorithms like topological sort and depth first search
2019 - 2019
virtual power systems
Scala Developer Intern
2018 - 2018
dilili labs
Machine Learning Intern
Developed data simulation methods to produce training data for an object detection problem • Wrote a simulator in C# that generates bounding boxes for simulated photos using the Unity game engine • Performed training and inference on pre-trained neural networks using Supervisely, a computer vision data warehousing platform
2017 - 2017
knowledge freeway co.
Intern Web Developer
Frontend and backend development in ASP.NET for .NET Framework • Worked in HTML, CSS, Javascript, C#, and SQL to design a web content administration system • Parsed log files with Powershell, converting data to Excel spreadsheet format using EPPlus
2010 - 2012
initio corporation
Analog Circuit Designer
Worked with simulation tools to deliver industry performant designs. • Used Cadence Virtuoso with OCEAN automation language to simulate circuits under stress-testing process corners • Utilized Verilog-A to design testbench models of 8b-10b encoded USB input
Experience
29 Skills
Algorithms
Amazon Elastic MapReduce (EMR)
Amazon S3
Amazon Web Services (AWS)
analytics
apache
Apache Spark
Application Programming Interfaces (API)
architecture
Backend
Big Data
CI/CD
Continuous Integration
Data Engineering
Dependency Injection
DevOps
Extract, Transform, Load (ETL)
Functional Programming
Integration
Kafka
Microservices
PostgreSQL
pyspark
Python
Scala
Software Engineer
SQL
SQLite
storage
Education
2013 - 2018
santa clara university leavey school of business
Master's degree
Computer Engineering
2003 - 2009
university of california los angeles
Bachelor's degree
Electrical and Electronics Engineering
2003 - 2009
university of california los angeles
Bachelor's degree
Microbiology and Immunology
