My Shortlist

Your shortlisted jobs will appear here. To view your shortlist, please login or register

DATE ADDED: Wed 11/09/2019

Senior Hadoop/Spark Big Data Engineer

Memphis, US
ADD TO SHORTLIST APPLY NOW

COMPANY: COOK SYSTEMS INT'L

JOB TYPE: Contract, FullTime

Cook Systems has an immediate need for a Senior Hadoop/Spark Big Data Engineer in Memphis, TN

Over seven years of experience in Data Engineering functions

Over four years of years experience writing complex, high performance queries and experience with distributed querying like Spark SQL for Hive.

Over four years of experience developing, managing, and optimizing big data architectures and pipelines.

Over two years of experience automating data processing using workflows tools to schedule and manage dependency of various data pipelines (Ni-Fi , Oozie).

Over two years of experience working with unstructured data sets.

Over four years of experience with relational databases (Oracle, Teradata), schema design and dimensional data modeling.

Over four years of experience in successfully manipulating, processing, and extracting value from large and disconnected data sets.

Skillset:

Hadoop Hortonworks distribution

Hadoop Stack: Kafka, Ni-Fi, Oozie, Sqoop, Hive, and Spark

Apache Spark Programming & Building Data Pipe lines for Apache Spark ( Databricks )

Nifi Flow Management

Scripting languages: Python

ETL tools: Abinitio

Statistical/ML tools: Spark MLib, DataIku, Python Libraries NumPy, Scikit, Pandas

Databases: Oracle, Teradata

e/o/e

Apply directly to our website or contact Boyd Foust at #removed# or (800) 266-5185 for further details.

- provided by Dice
APPLY NOW