Profile

Allen Han

Data Engineer at Capital One

5.1

Years of Experience

Education

santa clara university, university of california los angeles, university of california los angeles

Companies

capital one, capital one, apple, virtual power systems, virtual power systems, dilili labs, knowledge freeway co., initio corporation

Reach out to Allen Han via Email, InMail and SMS drip

by installing Chrome extension

Allen's contact details

Email

Email (Verified)

alXXXXXXXXXXXXXXXom

Experience

  • img

    2022 - Present

    capital one

    Data Engineer

    Data pipeline with Spark and PySpark on AWS • Scala syntax with DataFrame, Dataset, and Spark SQL APIs • Python syntax with DataFrame and Spark SQL APIs (Databricks) • Deployed on AWS EMR clusters, and triggered by serverless functions scheduled on Eventbridge • Read data from S3 backed storage, and write to S3 backed data lake as part of an ETL process • PostgreSQL for persisting data consumed by batch job

  • img

    2021 - 2022

    capital one

    Software Engineer

    Scala backend development for financial applications • Monix and ZIO for Kafka streaming • http4s and sttp for client-server communication • Microservices architecture based on Domain-Driven Design • Dependency injection with ZIO layers • Architecture concurrency model uses ZIO fibers and ZIO concurrency primitives • DSL and interpreter for financial transaction processing • DevOps based continuous integration with Jenkinsfile scripted pipelines

  • img

    2020 - 2021

    apple

    Scala Spark Software Engineer

    Graph-based big data engineering with Apache Spark • Map-reduce style programming with RDD API with Scala to manipulate geographic map data • GraphX and Pregel for message-passing style semantics • Use graph algorithms like graph partitioning and connected components to solve data quality problems at scale • Analytics processing of CSV output with Python and SQLite

  • img

    2019 - 2020

    virtual power systems

    Software Engineer - Scala

    Scala backend development using the Akka toolkit • Actor model for asynchronous, non-blocking multithreading • REST APIs written with Akka-http and Circe. • Elasticsearch for storing time-series data • Functional programming with type-classes and category theory inspired abstractions • Object-oriented entities for expressing business logic • Implemented graph algorithms like topological sort and depth first search

  • img

    2019 - 2019

    virtual power systems

    Scala Developer Intern

  • img

    2018 - 2018

    dilili labs

    Machine Learning Intern

    Developed data simulation methods to produce training data for an object detection problem • Wrote a simulator in C# that generates bounding boxes for simulated photos using the Unity game engine • Performed training and inference on pre-trained neural networks using Supervisely, a computer vision data warehousing platform

  • img

    2017 - 2017

    knowledge freeway co.

    Intern Web Developer

    Frontend and backend development in ASP.NET for .NET Framework • Worked in HTML, CSS, Javascript, C#, and SQL to design a web content administration system • Parsed log files with Powershell, converting data to Excel spreadsheet format using EPPlus

  • img

    2010 - 2012

    initio corporation

    Analog Circuit Designer

    Worked with simulation tools to deliver industry performant designs. • Used Cadence Virtuoso with OCEAN automation language to simulate circuits under stress-testing process corners • Utilized Verilog-A to design testbench models of 8b-10b encoded USB input

Experience

33 Skills

Algorithms

Amazon Elastic MapReduce (EMR)

Amazon S3

Amazon Web Services (AWS)

analytics

apache

Apache Spark

Application Programming Interfaces (API)

architecture

Backend

Big Data

CI/CD

Communication

Continuous Integration

Data Engineering

Databricks

Dependency Injection

Design

DevOps

Domain-Driven Design (DDD)

Extract, Transform, Load (ETL)

Functional Programming

Integration

Kafka

Microservices

PostgreSQL

pyspark

Python

Scala

Software Engineer

SQL

SQLite

storage

Education

  • img

    2013 - 2018

    santa clara university

    Master's degree

    Computer Engineering

  • img

    2003 - 2009

    university of california los angeles

    Bachelor's degree

    Electrical and Electronics Engineering

  • img

    2003 - 2009

    university of california los angeles

    Bachelor's degree

    Microbiology and Immunology

Colleagues at capital one

tracy donmoyer

senior platform engineer

imgPhoneimgEmail

titus deng

associate software engineer

imgPhoneimgEmail

tom yang

senior manager, software engineering

imgPhoneimgEmail

tony xu

senior software engineering

imgPhoneimgEmail

trent tobler

master software engineer

imgPhoneimgEmail

Show more

Others named Allen

Allen Nithish Kumar

Software Engineer

 at capital one

Allen Dooley, CISM, CISSP

Senior Software Engineer and Lead Database Adminstrator

 at capital one

Allen Lavoie

Software Engineer

 at capital one

Allen Madathil

Software Developer

 at capital one

Allen Cutinha

Senior Computer Vision Engineer

 at capital one

Show more

Colleagues at capital one

vamshi nimmalapalli

master software engineer

imgPhoneimgEmail

vamsi kavuri

master software engineer

imgPhoneimgEmail

Varun Dhiman

Senior Staff Software Engineer

imgPhoneimgEmail

varun nalamati

master software engineer

imgPhoneimgEmail

varun giridhar

software engineer

imgPhoneimgEmail

Show more

Colleagues at apple

Safiya Pathan

Senior Software Engineer

imgPhoneimgEmail

Sarpa Sagaram

Engineering - Ad Platforms

imgPhoneimgEmail

sagar haldankar

senior software engineer

imgPhoneimgEmail

Himanshu Sagar

Software Engineer

imgPhoneimgEmail

Sagar Kanumalla

EPM, Enterprise Technology

imgPhoneimgEmail

Show more