About

Saikiran Durga is a Senior Data Engineer at Microsoft with over 6 years of relevant experience in designing metadata-driven architecture to migrate data from different on-premise source systems such as Oracle, Netezza, Sybase, Unica, and SQL Server. He has designed data pipelines using Pyspark as a coding framework and ensured the reusability of the Pyspark code by using a metadata-driven processing framework. He has also laid down DevOps processes for code migrations for higher environments (QA, UAT, Prod) and automated CI/CD pipelines using Azure DevOps and Release pipelines. Saikiran has strong expertise in Azure Databricks, Azure Datafactory, Azure Data Lake, Azure SQL Server, and Python scripting and has used these tools to design and process large volumes of data (TBs) to build an enterprise data warehouse, data marts, data lake, and design common data models. Saikiran is responsible for customer delivery and capturing business requirements, has worked as a team member and independent lead for designing and architecting migrating on-prem Data Warehouse to the cloud, and providing seamless solutions by understanding the existing Data/Infrastructure Landscape. His most experience carries across the retail domain and has acted as a module lead for Orders, products, Order Shipments fact, and dimension design and data loads. Saikiran is currently studying at IIITB to pursue a degree in data science. He has worked with Agile methodologies of project delivery to ensure project/operation guidelines are met and respecting the compliance of the company. He is hands-on with JIRA/Azure DevOps. Saikiran's past work experiences include being a Lead Consultant at ITC and a student at the International Institute of Information Technology Bangalore. Saikiran has an educational background in Computer Science, having obtained an Engineer's Degree from Jawaharlal Nehru Technological University, Kakinada, and an Intermediate degree from Sree Chaitanya Junior Intermediate College. He is currently pursuing a PGDM in ML & AI from IIIT Bangalore. Saikiran has a strong tech stack that includes Azure, Data Engineering, SQL, Databricks, DevOps, Spark, Python, CI/CD, QA, Data Scientist, Data Warehouse, ETL, Infra, Research Scientist, Docker, HDFS, Snowflake, MapReduce, Big Data, test, MSSQL, Hadoop, Kafka, and Web.