Amol Zinjade
Development
Maharashtra, India
Skills
Data Engineering
About
Amol Zinjade's skills align with Database Specialists (Information and Communication Technology). Amol also has skills associated with System Developers and Analysts (Information and Communication Technology). Amol Zinjade has 8 years of work experience.
Work Experience
Senior Data Engineer
Globant
November 2021 - Present
- • Utilized Azure Databricks to develop PySpark scripts and store data in ADLS. • Developed Raw, Silver and Golden layers in ADLS. • Implemented Initial load & Incremental load for several sources for performing ETL using ADF pipeline orchestrations • Implemented Databricks workflows to seamlessly integrate the process of constructing a denormalized layer within Azure Data Lake Storage (ADLS), using MongoDB as the source and ADLS as the target • Implemented watermark table and CDC in Delta lake table. • Developed producers and consumers for stream-based data using Azure Event Hub and Kafka. • Created data pipelines for reading streaming data from MongoDB. • Created Neo4j graphs based on stream-based data. • Developed data pipelines on Azure to integrate Spark notebooks. • Developed ADF pipelines for a multi-environment and multi-tenant application.
Senior Software Engineer
The Lean Apps
July 2019 - November 2021
- • Integration of AWS Glue with different AWS services to make batch and stream based data processing • Proficient in working with DBT, a transformation and modeling tool used for building, testing, and deploying data pipelines in a version-controlled environment. • Utilizing AWS cloud services clusters to execute Hadoop ecosystems such as HDFS, Spark, and Hive. • Experienced in using BigQuery for data processing • Involved in data migration projects that move data from SQL and Oracle to cloud storage. • Skilled in designing and deploying dynamically scalable, fault-tolerant, and highly available applications on the AWS cloud. Associate, British Telecom, Bangalore SEPTEMBER 2 0 1 8 -- J U N E 2 0 1 9 • Executed transformations using Spark, MapReduce, loaded data into HDFS, and utilized Sqoop to extract data from SQL into HDFS. • Proficient in working with Azure Data Factory, Azure Data Lake, Azure Databricks, Python, Spark, and PySpark. • Implemented a cognitive model for telecom data using NLP and Kafka cluster. • Competent in big data processing utilizing Hadoop, MapReduce, and HDFS.
Software Engineer, DXC Technology
HPE
January 2016 - September 2018
- Proficient in data ingestion and ETL processes on the Hadoop platform, utilizing HDFS commands, Sqoop, and Spark. • Experienced in developing big data integration and analytics solutions based on Hadoop, using both Hadoop-based and web-based upload methods. • Collaborated with on-site clients to monitor the progress and address issues related to offshore development. • Competent in using MapReduce and Spark to identify the best-selling products and services, as well as to detect faulty data from telecom data sets.
Education
