Karthiknag Sirivaram
Development
WA, United States
Skills
Data Engineering
About
KARTHIK NAG SIRIVARAM's skills align with System Developers and Analysts (Information and Communication Technology). KARTHIK also has skills associated with Database Specialists (Information and Communication Technology). KARTHIK NAG SIRIVARAM has 16 years of work experience, with 5 years of management experience, including a low-level position.
View more
Work Experience
SENIOR DATA ENGINEER
VISTA
January 2023 - December 2023
- Building, optimizing and maintaining complex data pipelines to ingest, transform and deliver data with scheduling/monitoring/testing Built production grade data products using tools and technologies such as Snowflake, Databricks (Spark), Looker, Airflow, AWS services.tech Data observability using DBT, Elementary and python framework, CI-CD using gitlab runner and Terraform Data modeling on ga4, ga360 data, session, user segmentation, Channel pages, hits and events for the site visitor analytics. Maintaining and optimizing existing DBT jobs, Snowflake queries, Airflow pipelines. Work directly with analysts, data scientists, product owners and business experts in a multi-functional, agile, software development team.
DATA ENGINEER AND TECH LEAD
RAKUTEN
January 2018 - September 2022
- Designed and developed new ingestion and ETL pipelines using Kafka, Spark-scala framework, Hive and DAGs on Airflow, deploy applications on Kubernetes cluster with on premise hadoop clusters Manage code deployments and migrations through various environments SME for Data Delivery and Utilization teams at Rakuten E-Commerce and Coupon programs. Responsible for Build and support of Central Data Platform hosting all Rakuten businesses Migrating legacy BI data marts to Cloud platform and simulating test cases to retain ETL functionalities and report generations. Data investigation, exploratory data analysis and application of basic linear and logistic regression algos for coupon and price distribution. Managing and mentoring a team of six developers, Goals and career paths.
SENIOR DW-BI ENGINEER
KROGER
January 2016 - January 2017
- Performed Analytics that saved millions in cost savings on inbound and outbound transportation Communicating with the Product owners on a regular basis to Elicit, Analyze, Validate, and specify the real needs of the project stakeholders Design and develop Shell scripts for data ingestion, Hive hql scripts for ETL, analytics and reporting on Tableau. Design and initial development /Conceptualization of Hadoop Data Lake, Node/ cluster capacity distribution Basic text analysis and sentiment analysis on warehouse shipment feedback using ngrams
DW-BI DEVELOPER
COGNIZANT
February 2007 - December 2015
- Experience in planning, building, and managing successful large-scale Data Warehouse and BI-decision Support systems Expertise in Troubleshooting database problems, Performance tuning ETL sessions and mappings. SQL tuning and optimization using Explain Plan, and Skew Factor, resource usage, query log data and optimizer hints Manage code deployments and migrations through environments. Writing, updating and maintaining technical programs, end user documentation and operational procedures
Education
IIIT
Post Graduate Diploma in Data
Liverpool John Moores University
M.S in Data Science
