About

Rajesh Kumar is a highly skilled and certified Big Data Hadoop Professional with over 7 years of experience in Data Engineering using Big Data Tools. He has leveraged solutions using cloud technologies like Azure and GCP. Rajesh has developed ETL flows and data pipelines using Azure Data Factory and implemented data pipelines for streaming data using Spark Streaming, Kafka Streams, or Azure Events Hubs. He has transformed incoming data using Azure Databricks (Spark) as per business needs and created a Datalake. Rajesh has worked on ad-hoc requests to create data modelling whenever required for business needs. He has scheduled and monitored jobs using Airflow, Azure Data Factory. Currently, he is working as a Senior Data Engineer at Catalina Marketing Japan, where he has designed and architected the Big Data Platform using Azure Stack. He has developed ETL flows using Azure Data Factory to read third-party data into their data platform. Rajesh has experience in developing and optimizing Spark algorithms on huge datasets using Azure Databricks. He has supported the data science team to productionize the model using MLFlow and developed the aggregated SQL queries for creating KPIs to business owners. In the past, Rajesh has worked as a Hadoop Developer at Vupico, where he was involved in architecting the solution by analyzing the tools and their performance. He has also designed Kafka Topologies to extract data from IoT machines to HDP using HDF and developed Spark, Spark streaming applications for analyzing streaming data. Rajesh has hands-on knowledge of using NiFi, NiFi registry, and created NiFi flows to orchestrate the workflow from end to end. He has also created Hive Data Lakes to store data from SAP ERP and created Spark jobs using Python to clean and process large amounts of data. Rajesh completed his Bachelor of Technology in Computer Science from Bapatla Engineering College in 2014. He has a strong tech stack that includes Azure, Data Engineering, Spark, Big Data, Databricks, Hadoop, Kafka, Apache Airflow, Data Scientist, SQL, ETL, Python, CI/CD, Kubernetes, Docker, DevOps, GCP, Senior Software Engineer, and Apache Hive. With relevant experience of 8.28 years, Rajesh is a technically accomplished and skilled Data & Cloud Engineer.