Kesavan Ravichandran
Development
Tamil Nadu, India
Skills
Data Engineering
About
Kesavan R's skills align with System Developers and Analysts (Information and Communication Technology). Kesavan also has skills associated with Programmers (Information and Communication Technology). Kesavan R appears to be a low-to-mid level candidate, with 2 years of experience.
View more
Work Experience
Big Data Developer
December 2021 - Present
- is an Indian multinational online used car marketplace in Gurgaon. The company is considered among the four major organized player in the used car segment in india. Project Role: Big Data Developer Responsibilities: Performed step execution in EMR clusters for the job deployment as per requirements. Loaded data into Hive from Spark RDDs and data frames for further processing. Performed Import and Export of data into HDFS and Hive using Sqoop and managed data within the environment. Was responsible for Optimizing Spark Sql queries that helped in saving Cost to the project. Loaded and transformed large sets of semi structured data likes XML, JSON, Avro, Parquet Queried data using SparkSQL on top of Spark engine for faster datasets processing. Created multiple Hive tables, running hive queries in those data, implemented Partitioning, Dynamic Partitioning, and Bucketing in Hive for efficient data access. Processed web URL data using scala and converted it to data frames for further transformations. Generated complex JSON data after all the transformations for easy storage and access as per clientrequirements. As per the business requirement storing the spark processed data in HDFS/S3 with appropriate fileformats. Performed Import and Export of data into HDFS and Hive using Sqoop and managed data within the environment. Involved in creating Hive tables, data loading and writing hive queries Was responsible for Optimizing Hive queries that helped in saving Cost to the project. Managed Hive Tables and created child tables based on partitions. Involved in working on the Data Analysis, Data Quality and data profiling for handling the business that helped the Business team. Loaded and transformed large sets of semi structured data. Development of Code & peer review of assigned task and Bug fixing. Have done POCs using Apache Spark SQL Technologies: Spark, Scala, HDFS, Hive