About

Vipul Bharat Marlecha is a highly skilled software engineer with over 7 years of experience in building distributed data ingestion platforms, big data analytics pipelines, and petabyte-scale data warehouses. He is currently working as a Software Engineer - Data at DoorDash, where he is responsible for building petabyte-scale, distributed, and highly resilient real-time stream processing data solutions to power Merchant, Discover, Ranking, and Ads teams' data needs. Vipul has extensive experience in building low latency, high throughput, and distributed event-driven streaming services from scratch using technologies such as Apache Flink, Kafka, Snowflake, Airflow, AWS, and Kubernetes. He has successfully scaled up a streaming service to 30+ distributed Kubernetes pods, which currently processes 1+ billion events per day. Prior to joining DoorDash, Vipul worked as a Software Engineer - Data at Twitter, where he built real-time and offline solutions to make Twitter's revenue data accessible and reliable. He built a scalable data ingestion platform for all revenue teams, which runs managed batch jobs to move a large number of datasets from on-premises to the cloud. Vipul also worked on building a petabyte-scale distributed data warehouse for the revenue organization by leveraging Big Query. He built various large-scale tools and libraries that involved Big Query Onboarding tool, HDFS to Big Query data migration tool, Big Query to Druid data migration tools, and various serialization frameworks. Vipul has a Master's degree in Computer Science from the New Jersey Institute of Technology and a Bachelor's degree in Information Technology from PES University. He is highly proficient in technologies such as Kafka, Apache Airflow, Data Warehouse, Kubernetes, AWS, Snowflake, Big Data, Docker, Hadoop, HDFS, Data Engineering, GCP, Scala, Selenium, Jenkins, Python, Android, and more.