Cook Systems has an immediate need for a Senior Hadoop/Spark Big Data Engineer in Memphis, TN
Over seven years of experience in Data Engineering functions
Over four years of years experience writing complex, high performance queries and experience with distributed querying like Spark SQL for Hive.
Over four years of experience developing, managing, and optimizing big data architectures and pipelines.
Over two years of experience automating data processing using workflows tools to schedule and manage dependency of various data pipelines (Ni-Fi , Oozie).
Over two years of experience working with unstructured data sets.
Over four years of experience with relational databases (Oracle, Teradata), schema design and dimensional data modeling.
Over four years of experience in successfully manipulating, processing, and extracting value from large and disconnected data sets.
Hadoop Hortonworks distribution
Hadoop Stack: Kafka, Ni-Fi, Oozie, Sqoop, Hive, and Spark
Apache Spark Programming & Building Data Pipe lines for Apache Spark ( Databricks )
Nifi Flow Management
Scripting languages: Python
ETL tools: Abinitio
Statistical/ML tools: Spark MLib, DataIku, Python Libraries NumPy, Scikit, Pandas
Databases: Oracle, Teradata
Apply directly to our website or contact Boyd Foust at #removed# or (800) 266-5185 for further details.
- provided by Dice