Lofna Agnes
Development
New Jersey, United States
Skills
Data Engineering
About
Lofna Agnes's skills align with System Developers and Analysts (Information and Communication Technology). Lofna also has skills associated with Database Specialists (Information and Communication Technology). Lofna Agnes appears to be a low-to-mid level candidate, with 3 years of experience.
View more
Work Experience
Certified Developer in Languages C/C++
Udemy
February 2024 - February 2024
Bigdata Engineer
Kaiser Permanente
December 2020 - Present
- Func oned as a Data Engineer specializing in big data technologies, including Apache Spark 3.0, Delta, Apache Spark 2.4, Apache Airflow, Azure Cosmos DB client, Trino, and the Azure Cloud pla orm with Hortonworks. Proficient in Hadoop 3.x, u lizing Hive query engine, HBase, Spark, and Scala programming language, along with REST APIs. The KPD [Kaiser Permanente Digital] project on FHIR/HL7 is cra ed to collect, analyze, process, and furnish extensive healthcare data from diverse en es to the AI team in compliance with medical FHIR HL7 standards. Within the FHIR-Spark project, healthcare data undergoes transforma on into the FHIR/HL7 medical standard before being ingested into different NoSQL databases like HBASE and Azure Cosmos DB. The implementa on of the project is carried out using Apache Spark with Scala within the Azure HDInsight environment. Addi onally, a Spark Scala Consumer layer is integrated to retrieve the processed data from HBASE. The KPD Project UMP/Medicaid aims to develop a unified profile of extensive data in a custom format for various healthcare en es, catering to the requirements of the AI team. Roles & Responsibili es • Engineered a Big Data FHIR (Fast Healthcare Interoperability Resources) store to enable seamless machine learning on petabyte-scale data volumes u lizing Apache Spark and Scala. • Developed, constructed, tested, and maintained a comprehensive data management and processing system using Hadoop Big Data tools and frameworks within the Azure cloud environment. Domain Experience US Healthcare, Retail, Telecom Medical Devices. Cer fica ons/Trainings Certified Bigdata Data Science/Analytics/ Implementation