Databricks Engineer Location: Plano, TX Hybrid ( need candidates within TX) Experience : 10 + years Must Have: 1. Databricks2. Apache Spark3. Python(and/or Scala)4. AWS5. SQL6. Java7. CI/CD Pipeline tools Minimum Industry experience: 10 yearsJob Description:1. Bachelor's degree or equivalent work experience2. Must have experience implementing atleast 2 end to end projects with Databricks which includes components like- Delta lake- Unity Catalog- Databricks Connect- DataBricks API- Databricks workflow Orchestration3. Must be well-versed with Databricks Lakehouse concepts and its implementation in large scale enterprise environments4. Must have good understanding to create complex data pipelines and use of data ingestion tools like nifi5. Must be well versed in using Apache Spark framework and strong in SQL and spark-sql6. Must have excellent coding skills in Python(and/or Scala), preferably Python7. Must have strong performance optimization skills to improve efficiency and reduce cost using techniques like parallel processing8. Must have worked on AWS and should have working experience of AWS services like S3, Lambda, DynamoDB, SQS, CloudWatch9. Must be able to work with architects and lead engineers to design solutions to meet functional and non-functional requirements10. Must have strong written and verbal communication skills11. Must have experience in an Agile environment12. Data engineering background is a plus