Data Engineer with advanced Python skills and NumPy. Someone who can use Python scripts to pull data from Hive tables and has the ability to do analysis.

The consultant will Develop and maintain custom, complex ETL pipelines written in Python, some Airflow, Spark, Hive. Migrate legacy data pipelines (Oracle Server, some RedShift) to newer technologies Migrate data pipelines from a legacy systems

Required Skills & Experience

• Programming in Python


• NumPy


• Airflow


• Big Data experience, such as Hadoop, Hive, Spark


• Experience working with large pools of data, especially Finance Data


• AWS