My Shortlist

Your shortlisted jobs will appear here. To view your shortlist: Login Or Register

More Jobs Like This
Date Added: Thu 10/06/2021

Spark / Scala Developer

Plymouth Meeting, PA, US
Add To Shortlist Apply Now


Job Type: Permanent, FullTime

RESPONSIBILITIES Kforce has a client in Plymouth Meeting, PA that is searching for a SparkScala Developer. Responsibilities Develop end to end data pipeline using Spark, Hive and Impala Write SPARK jobs to fetch large data volumes from source Understand business needs, analyze functional specifications and map those to development and designing Apache Spark programs and algorithms Optimizing Spark code, Impala queries and Hive partitioning strategy for better scalability, reliability and performance Work on leading BI technologies like MSTR, Tableau over Hadoop Ecosystem through ODBCJDBC connection Work on hive performance optimizations like using distributed cache for small datasets, Partition, Bucketing in Hive and Map Side joins Build Machine Learning Algorithms using Spark Design and deploy enterprise-wide scalable operations Data wrangling and creating workable datasets and work on different file formats like Parquet, ORC, Sequence files and different serialization formats like Avro Build applications using Maven, SBT and integrated with continuous integration servers like Jenkins to build jobs Execution of Hadoop ecosystem and Applications through Apache HUE Feasibility Analysis (For the deliverables) - Evaluating the feasibility of the requirements against complexity and time lines Performance tuning of Impala queries Design and documented operational problems by following standards and procedures using software reporting tool JIRA Installing, configuring, and using Hadoop components like Spark, Spark Job server, Spark Thrift server, Phoenix on HBase, Flume, Sqoop REQUIREMENTS 3+ years of strong experience in database and data warehousing concepts and techniques Must understand relational and dimensional modeling, starsnowflake schema design, BI, Data Warehouse operating environments and related technologies, ETL, MDM, and data governance practices Candidates qualifying for this position will have similar experience along with the skills and abilities to perform the duties mentioned Any relevant education andor training will be considered a plus Kforce is an Equal OpportunityAffirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
Apply Now