Spark Engineer

Posted on Feb 14, 2019 by Request Technology

Chicago, IL 60601
Information Technology
Immediate Start
$90k - $120k Annual
Full-Time

A prestigious company is on the search for a Spark Engineer. This individual needs to have 5+ years of Cloud data infrastructure. They also need to have 5+ years of experience with hands on design and coding in Spark/Scala. They also need experience with using Kafka and AWS.

Responsibilities:

  • Create and manage a scalable ETL pipeline usable by anyone (engineers, data scientists) for a variety of purposes (analytics, dashboards, visualizations, machine learning) including infrastructure and abstractions.
  • Propose services, frameworks, and other capabilities that you predict will be a necessity in the future
  • Build and maintain a robust data collection system that reaches across multiple sources and data marts
  • Monitor and tune existing infrastructure in close collaboration with the ops team

Required Qualifications:

  • 5+ years of experience in Cloud Data Infrastructure
  • 5+ years of experience with hands on design and coding in Spark/Scala
  • 5+ years of experience in MongoDB
  • 3+ years of experience in data streaming using Kafka
  • 3+ years of experience AWS
  • Experience in designing and scaling data infrastructure, models, and pipelines
  • Expertise in RDD, In-Memory computation in Spark, Fault Tolerance in Spark, Real Time stream processing

Skills and Abilities:

  • Experience deploying Cloud environments
  • Competence in integrating systems through APIs
  • Excellent technical troubleshooting skills
  • Ability to demonstrate excellent organization and communication skills to successfully build and maintain relationships with designers, engineers, and data scientists

Reference: 646204335

Similar Jobs

Spark Engineer

Chicago, IL

Request Technology - Anthony Honquest

Spark/Scala Engineer

Chicago, IL

Request Technology - Kyle Honn

Spark Scala Engineer

Chicago, IL

Request Technology - Craig Johnson

DevOps Engineer

Chicago, IL

TeamBradley