Hassan Shah Lakhani
Development
Sindh, Pakistan
Skills
Data Engineering
About
Hassan Shah Lakhani's skills align with System Developers and Analysts (Information and Communication Technology). Hassan also has skills associated with Programmers (Information and Communication Technology). Hassan Shah Lakhani appears to be a low-to-mid level candidate, with 3 years of experience.
View more
Work Experience
Big Data Engineer
Daraz
October 2022 - Present
- • Responsible for designing and developing optimized scripts to deploy ETL jobs using HiveSQL, PostgreSQL and Python to improve the operational efficiency of customer centric processes. • Constructed a data warehouse design and data preparation framework by implementing a solid, robust, and extensible architecture that caters to key business flows and requirements from diverse business and operational stakeholders. • Developed a dashboard to monitor seller progression within the application, evaluating drop-off rates and module-specific time utilization, with the goal of enhancing seller experience and optimizing onboarding efficiency. • Built REST APIs using OneService technology and created Python and Shell scripts to automate scheduled tasks for the business, effectively reducing redundancy and latency. • Developed a robust UI application facilitating on-demand triggering of tables and shell nodes for business operations within Alibaba Cloud, using libraries including MaxCompute (ODPS) for cloud computing, along with pandas, NumPy, and PyQt5 for efficient data handling and interface development. • Created comprehensive dashboards that enabled all relevant parties to monitor and access key performance indicators (KPIs) from various departments across multiple ventures. Additionally, these dashboards allowed stakeholders to assess the performance of the Seller's application in detail, testing the efficiency of different modules and their usage.
Data Engineer
Systems Limited
July 2021 - September 2022
- Developed ETL pipelines on NIFI and Fivetran using Python, SQL and NIFI expression language to extract, transform and load big data in file storages and data warehouses. • Managed the development cycle, by learning and comprehending the requirements, translation into code followed by their deployment to a production environment. • Worked with AWS services like S3, Redshift, Athena, EMR, Lambda, Step function and Amazon Managed Workflows for Apache Airflow for data ingestion and data orchestration. • Performed data analysis to troubleshoot and remediate ingestion and post-ingestion issues raised by pipeline alerts or downstream consumers. • Developed, instrumented, and maintained dashboards and visualizations on Power BI to report information and provide guidance to business partners on business-critical metrics to ensure that organizational KPIs are managed appropriately.
Data Analyst Intern
Careem
February 2021 - May 2021
- • Used Python to regionalize restaurants into zones and automated the process. • Performed exploratory analysis on the zonal data to extract insights to elevate merchant reliability. • Administered and operated Careem's backend product "Saturn", housing more than 1500 outlets. • Used Redash and MySQL for the creation of complex queries that extract key data and insights from the analysis of KPIs relevant to Careem's food delivery service.
Software Quality and Assurance Intern
Afiniti
July 2020 - August 2020
- • Tracked and isolated bugs throughout the testing phase of an e-commerce support software. • Documented the test cases, procedures and results, and reviewed user interfaces for consistency and functionality.
Education
