Uma Shankar Vasanthakumar
Development
KRAKOW, Poland
Skills
Data Engineering
About
V. UMA SHANKAR's skills align with Database Specialists (Information and Communication Technology). V. also has skills associated with System Developers and Analysts (Information and Communication Technology). V. UMA SHANKAR has 12 years of work experience, with 4 years of management experience, including a low-level position.
View more
Work Experience
Big Data Engineer
L&T Mindtree Pvt Ltd
August 2022 - Present
- Krakow, Poland. * Developed and maintained end-to-end operations of ETL data pipelines and worked with large data sets in Azure Data Factory, Azure Synapse and Azure Databricks * Researched and implemented various components like pipeline, activity, mapping data flows, data sets, linked services, triggers and control flow. * Performed extensive debugging, data validation, error handling mechanism, transformation types and data clean up analysis within large datasets. * Worked on migration of data from On-prem SQL server to Cloud databases (Azure synapse Analytics (DW) & Azure SQL DB). Data Integration and storage technologies with Jupiter notebook and MySQL. Collaborated with DevOps Engineer to developed automated CI/CD and Test-driven development pipeline using Azure as per client standards.
BI Consultant
Forsches Info Tech Private Limited
April 2021 - August 2022
- Poland. * Design and develop Spark applications using Pyspark and Spark-SQL for data extraction, transformation and aggregation from multiple file formats for analysing & transforming the data to uncover insights into the customer usage patterns. * Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL. Have designed and developed ETL mapping for data collection from various data feed using REST API. * Created Pipelines in ADF using Linked Services/Datasets/pipeline to Extract, Transform and Load data from different sources like Azure SQL, BLOB Storage, Azure SQL Data Warehouse. * Create predictive and prescriptive models using tools from data science such as Azure Machine Learning..
Data Modeler Technical Lead
Renault Nissan Business and Technology Private Limited
September 2016 - November 2019
- * Collaboratively worked with business users to analyze and document database system requirements, and communicate progress. * Work with stakeholders to translate business requirements into data science solutions by understanding business requirements. * Demonstrate a Kimball full understanding of the Fact/Dimension data warehouse design model, including star, Data Vault and snowflake design methods. * Design and develop the data factory pipelines to move the data from oracle database to Azure Data Lake Data Lake Store.
Data Modeler Team Lead
Magna Info Tech Private Limited
February 2016 - September 2016
- India. * Clarified the requirements by talking to the user groups and accordingly modified the functional and technical specifications. * Utilize Azure technologies like Azure Cognitive Technologies, Azure Machine Learning, and Azure Bot Services to design, create, and deploy AI-based applications. * ETL implementation using SQL Server Integration Services (SSIS). Designed and implemented product data vault to extract, transform and load the product data with history of changes on the products attributes. * To include AI components into data workflows, engage with data scientists and data engineers. * In Azure environments, create and implement machine learning models and algorithms. * Developed Tableau data visualization using Cross tabs, Heat maps, Box and Whisker charts, Scatter Plots, Geographic Map, Pie Charts and Bar Charts and Density Chart.
Senior Software Engineer / Architect - IT (Information Technology)
IBM India Private Limited
August 2011 - August 2011
- India. * Develops ETL technical specifications, designs, develops, tests, implements, and supports optimal data solutions. * Good Understanding of Big Data Hadoop and Yarn architecture along with various Hadoop Demons such as Job Tracker, Name Node, Data Node, Resource/cluster Manager and Kafka. * Estimation and outlining of the solutions needed to implement cloud migration as well as continued operations are also part of a solutions architect job profile. * Azure Data Factory to upload SSIS package to transfer data, initial setup for Converting SSIS from Azure Iaas to Paas. * Similar to the ML engineer except that he/she focuses on data development. A data engineer is mainly involved in data pipelines moving data between environments and tracking their lineage. * Designed and deployed machine learning models for predictive analysis, increasing prediction accuracy by 25%.
Software Engineer - IT(Information Technology)
UST Global India Private Limited
November 2009 - December 2011
- India. * Clarified the requirements by talking to the user groups and accordingly modified the functional and technical specifications. * Designed and implemented facts, dimensions and OLAP cubes using dimensional data modeling (ERWIN) standards in SQL Server that maintained data, developed reports on SSAS Cubes as data source. * Building complex SQL queries to extract the required data and leveraging Excel or reporting solutions like Tableau, Power BI etc. to communicate the insights. * Ability to develop ETL pipelines in and out of data warehouse using combination of Python and Snowflake's SnowSQL.
Software Programmer - IT(Information Technology)
August 2006 - November 2009
- Pondicherry, India. * Developed and supported software for company needs. Designed and developed database tables, triggers, cursors, procedures, functions and packages to meet business requirements. * Developed and modified PL/SQL code to make new enhancements or resolve problems, as per customer requirements. * Design, development, and maintenance of applications written in PL/SQL, Oracle 11i forms, Oracle 11i reports, Python and UNIX. * Created and maintained developer-level and user-level artifacts that included software version or requirement documentation, deployment guides and user manuals as well as generated project reports using Python Report Lab for clients as required.
Education
