About

Nishant Panwar is a highly experienced Data Engineer with over 7 years of experience in the field. He currently works as a Data Engineer at General Electric, where he is responsible for developing and deploying distributed computing Big Data applications on a scale using Open Source framework Apache Spark on Cloudera distribution of Hadoop. He is also well-versed in utilizing Hadoop modules such as YARN, MapReduce, HDFS, Hive, Impala and other tools and technologies like SQL, Control M, Shell Scripting, etc. to optimize the data pipelines by partitioning and bucketing concepts in Hive and Apache Spark. Prior to his current role, Nishant worked as a Big Data consultant for Anthem, a US-based insurance company. Here, he was solely responsible for almost all of the work, including interacting and collaborating directly with data scientists, data strategy consultants, and digital analytics to bridge business requirements with data engineering. He also performed root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Nishant has also worked at Accenture as a Hadoop Developer, where he was involved in creating business requirement documents and data flow designs, technical specification documents as per business requirements. He has experience in creating Hive Tables, loading them with data, and writing Hive queries which will invoke and run Map-Reduce jobs in the backend. He is also well-versed in working with Cloudera Manager 5.x and Hue. Nishant holds a Bachelor of Technology degree in Electronics and Communications Engineering from Vellore Institute of Technology. He is highly skilled in Data Engineering, Big Data, Spark, Hadoop, SQL, CI/CD, Apache Hive, HDFS, Bamboo, MapReduce, SDET, test, DevOps, Integration, Scala, and Backend. Apart from his work, Nishant takes a keen interest in training freshers by hosting sessions/talks on new technologies and also being a part of a POC effort to explore new open source tools. He is also responsible for interviewing candidates.