| 20,000+ Fresh Resumes Monthly | |
|
|
| | Click here or scroll down to respond to this candidateCandidate's Name
Senior Data EngineerPROFESSIONAL SUMMARYAmbitious Data Engineer with 10 years of expertise in Data Integration, Data Warehousing/Data Lake, and Data Migration. Proficient in designing and implementing scalable, secure data structures, optimizing performance and developing comprehensive data models. Exceptional at self-management, task prioritization and quickly adapting to new technologies. Confident working independently or collaboratively with excellent communication skills to drive user experience and customer satisfaction. WORK EXPERIENCESenior Data EngineerQurate Retail GroupAug 2024 Present Austin, TX Developed efficient ETL/ELT pipelines using DBT for data transformation, Snowflake as the data warehouse and Airflow for orchestration of workflows. Developed Airflow DAGs using Email Operator, Bash Operator and Spark Livy Operator to execute tasks on an EC2 instance and Utilized Python scripting in Airflow DAGs to perform data transformation and validation tasks Implemented CI/CD pipelines using Apache Airflow to deploy data processing workflows on AWS EMR through Jenkins.Senior Data EngineerServiceNowSep 2018 Mar 2024 Hyderabad Orchestrated seamless integration from O365 MS Exchange into Snowflake and HANA using MS Graph API and python reducing costs by bypassing third-party tools. Developed bi-directional data pipeline between Snowflake and BIGDATA, eliminating duplicate data sourcing efforts, leading to 25% increase in project efficiency. Developed ETL workflows in Matillion and SAP BODS to integrate data from multiple sources (AWS S3, Blob Storage, relational databases, APIs) into Snowflake by leveraging Snowflake's native features like clustering, partitioning, auto-scaling and query optimization.Senior Software EngineerHCL technologies Ltd.Dec 2017 - Sep 2018 Bangalore Created Stored Procedures, Functions, Packages and Triggers using SQL and PL/SQL, enhancing database functionality and efficiency. Implemented indexes on tables to improve query performance by eliminating full table scans and simplifying complex queries with views. Fine-tuned procedures and SQL queries across multiple databases achieving 40% increase in execution speed using Explain Plan and Oracle Hints. Systems EngineerTata Consultancy Services Ltd.Jun 2014 - Dec 2017 Bangalore Developed automated ETL framework engine using PL/SQL packages, procedures, and Scheduler objects significantly improving data processing efficiency by 50%. Created external tables to load data from flat files, CSV, and TXT files into Oracle databases, streamlining data ingestion processes. Designed and implemented Daily, Weekly, and Monthly loads using Incremental Load strategies SCD Type 1 and Type 2 ensuring data accuracy and timeliness. EMAIL AVAILABLEPHONE NUMBER AVAILABLELinkedInAustin, TXCERTIFICATION Matillion Associate Certification AZ-900 Microsoft AzureFundamental Snowpro Core CertificationSKILLS Programming: Python, Scala,Shell Scripting, PL/SQL Big Data Technologies: Hadoop(HDFS, Impala, Hive, Hue,Zookeeper), Spark, PySpark ETL & Data Pipelines: Matillion,SAP BODS, ODI, Airflow(Orchestration), dbt Databases: Snowflake, Oracle,SAP HANA, SQL Cloud Platforms: Azure (DataFactory, Databricks, BlobStorage, Data Lake, StorageExplorer), AWS (Glue, S3, EMR,EC2), GCP (BigQuery, Dataproc) CI/CD Tools: Jenkins, GitHub,GitLab Data Warehousing, DataModelling Docker, SplunkEDUCATIONBachelor of Technology in ComputerScience and EngineeringSree Vidyanikethan Engineering CollegeOct 2010 May 2014 Tirupati, A.PAWARDS DT Quarterly Award (Q3, 2023):For exceptional performance. Kudos for Going Above andBeyond (Q2, 2023): For exceedingexpectations and commitment. Wow Our Customers Award (Q1,2023): For delivering exceptionalcustomer service and satisfaction. D&A Award (2022): For significantcontributions to data and analyticsinitiatives. |