| | | 20,000+ Fresh Resumes Monthly | |
|
|
| |
Click here or scroll down to respond to this candidate
+1 (Street Address )-248-9441 | https://LINKEDIN LINK AVAILABLE| EMAIL AVAILABLE
Experienced Data Analytics Engineer, specializing in designing, building and implementing scalable data pipelines and analytics solutions. Proficient in SQL, Python, AWS and data warehouse like Snowflake. Adept at leveraging big data technologies to extract actionable insights and support data-driven decision-making. Proven track record of optimizing data processes and enhancing business performance through advanced analytics.SKILLS
Programming Languages : Python, SQL, PHP, C++, Shell ScriptingDatabases : Microsoft SQL Server, MySQL, PostgreSQL, MongoDB, SQLite, Dynamo DBPython Libraries : Pyspark, Pandas, NumPy, Beautiful Soup, Matplotlib, Jinja2, Unit test
Big Data : Spark, Hive, Linux, EMRVersion Controls : Git, GitHub, BitbucketWeb Technology : HTML5, CSS3, Java script, Ajax, jQuery, BootstrapOther Tools : Snowflake, Databricks, AWS (EC2, S3, RDS, DynamoDB, Lambda, Redshift, EMR, Glue,
Athena), Matillion, ETL, JIRA, MS Excel, Docker, Airflow, Terraform, Data Pipeline, Data Modeling, Data LakeEDUCATIONNew York Institute of Technology, New York, New York May 2018 master s in computer scienceIndus University, Gujarat, India June 2011 bachelor s in computer engineeringEXPERIENCE
Amplify Loyalty Solution
Data Analytics Engineer | July 2022 Present Developing and implementing scalable data pipelines utilizing AWS services such as S3, Glue, and Athena. Engineer multi-layered data pipelines in AWS Glue for efficient data loading and analytics using Athena. Develop optimized Athena data sources for seamless querying on S3. Create and execute SQL queries, ranging from basic to advanced, for in-depth data analysis and troubleshooting. Expertise in designing ETL workflows using Python, including Pyspark and Pandas. Strategize and execute advanced data migration processes for enterprise data warehouses. Automated data pipelines leveraging SQL and Python-based ETL frameworks. Contribute to the reference architecture and design of comprehensive data lake and warehouse solutions. Conduct advanced data analysis and provide solutions to critical issues using SQL.Blue KCData Engineer | February 2022 June 2022 Designed and developed modern data solutions on Azure to enable advanced data visualization. Implemented ETL processes to migrate data from Azure resources to Snowflake via Azure Data Factory. Built and optimized ADF pipelines using Linked Services and Datasets for seamless data integration from ADO, Blob Storage, and Azure Data Lake. Utilized public cloud-managed services in Azure for data warehousing and analytics. Designed and deployed robust database solutions in Azure SQL and Snowflake. Developed complex SQL queries to drive data analysis and meet business objectives.Capital OneData Analytics Engineer | July 2021 January 2022 Independently engineered and tested Hive-based solutions for data loading and registration within Data Lake and Data Warehouse environments. Developed and optimized Hive tables, writing complex SQL queries to analyze and manage large datasets. Registered critical datasets in Exchange for S3, One Lake, and Snowflake, ensuring data accessibility and security. Used Hive script and Amazon Elastic MapReduce (EMR) for unit testing. Used Hive to do transformations, event joins and some pre-aggregations before store and register data into snowflake. Conducted comprehensive data analysis, validation, and testing using Snowflake, Hue Editor. Leveraged Spark and Databricks for large-scale data transformations, enhancing data processing capabilities. Extensively worked using AWS services along with wide and in depth understanding of each one of themVanguardData Engineer | February 2020 May 2021 Independently developed, tested, implemented, and maintained complex data systems, driving operational efficiency. Led the migration of applications from an internal data center to AWS Cloud, utilizing Python scripts for seamless transition. Integrated AWS services using Python packages (boto, boto3), enabling efficient backend programming and automation. Engineered and managed data pipelines, DBMS tables, and data models, supporting data-driven decision-making. Demonstrated expertise in SDLC stages, cloud formation templates, and AWS resource deployment, ensuring project success. Leveraged deep knowledge of AWS services to optimize data integration and management processes.Health Savings AdministratorsData Analytics/Engineer | July 2019 December 2019 Designed and implemented large-scale data intelligence solutions using Snowflake Data Warehouse, enhancing business intelligence. Led all phases of data warehouse development, including ETL processes for integrating data from multiple sources. Developed and optimized ETL pipelines and jobs using Matillion, Python, and SnowSQL, ensuring data accuracy and consistency. Maintained ETL workflows, data management, and query components, supporting efficient data operations. Utilized SQL and relational databases for data extraction and management, driving business insights.Capital OneData Analyst | February 2019 May 2019 Extracted and analyzed data to identify and solve business problems, driving operational improvements. Supported cloud-based data warehouses, including Snowflake, and led data migration from Teradata to Snowflake. Applied Fact/Dimension warehouse design models and automated data retrieval using SQL, streamlining reporting processes. Involved on Data migration project from Teradata to Snowflake. Utilized Databricks and Pyspark for high-scale analytics and SQL-to-Spark transformations, enhancing data processing efficiency. Reviewed and managed data migration between systems, ensuring data integrity and accuracy. Leveraged BI tools like Tableau for data visualization, enabling data-driven decision-making. Working Experience with Amazon Web Services (AWS) in an enterprise environment. |
