Amjad Khan
Development
Madhya Pradesh , India
Skills
Data Engineering
About
AMJAD KHAN's skills align with System Developers and Analysts (Information and Communication Technology). AMJAD also has skills associated with Programmers (Information and Communication Technology). AMJAD KHAN has 6 years of work experience.
View more
Work Experience
Data Engineer
SMART CONTROLS INDIA LTD
December 2017 - Present
- India Roles/Responsibilities Responsible for Building Spark data pipelines Using Bigdata/Hadoop technology stack. Used PySpark and Spark data frames for data processing and transformation to load data to warehouse tables. Developing Spark Jobs using various transformation and action API to meet the business need. Worked on various Spark optimization techniques such as code level and resource level. Which gives a lot of performance gain. Followed agile-sprints and code versioning through GIT. Worked on Sqoop to load logs and other live inputs to HDFS Provide extraction and other data analysis based on customer feedback and review. Worked on Sqoop import/export with incremental load to extract the data into HDFS. Worked on Hive optimization performance using Partitioning, Bucketing and Map on both Managed and External tables.
Education
