Senior Data Engineer-Spark/Databricks Job at Enable Data Incorporated, Minneapolis, MN

ZXBNMEIxRWNLcjhVNTVPT3lLZDJzNkxKVkE9PQ==
  • Enable Data Incorporated
  • Minneapolis, MN

Job Description

Job Responsibilities:
  • Design, code, test, document, and maintain high-quality and scalable Big Data solutions in public and on-prem cloud.
  • Research, evaluate, and deploy new tools, frameworks and patterns to build sustainable Big Data platform.
  • Identify gaps and opportunities for improvement of existing solutions
  • Define and develop APIs for integration with various data sources in the enterprise
  • Analyze and define customer requirements.
  • Assist in defining product technical architecture.
  • Make accurate development effort estimates to assist management in project and resource planning.
  • Create prototypes, proof-of-concepts & design and code reviews
  • Collaborate with management, quality assurance, architecture, and other development teams
  • Write technical documentation and participate in production support.
  • Keep skills up to date through ongoing self-directed training.
  • The ideal candidate will be a self-starter who can learn things quickly who is enthusiastic, active, and eager to learn.
Requirements

Required qualifications:
  • Bachelor's degree in a technical field, or equivalent experience.
  • 10+ years of hands-on Software Development experience using Java or Scala.
  • 8+ years of experience in Hadoop, MapReduce, HDFS, Spark, Streaming, Kafka and NoSQL
  • 8+ years of experience in at least one major public cloud platform (Azure or AWS preferred)
  • 8+ years of previous relational database experience working with DB2, Oracle or SQL Server
  • Hands on experience with Databricks
  • Thorough understanding of service-oriented architecture (SOA) concepts.
  • Previous experience with Agile/SCRUM methodology/best practices
  • Previous experience and successful track-record of learning new tools and technologies and leveraging these on integration and implementation projects
  • Databricks certification preferred

Job Tags

Similar Jobs

HSN

On-call Creative Product Photographer Job at HSN

US13149 The Opportunity The Creative Product Photographer is responsible for producing Creative Brand quality product images for items on all of HSN Platforms. The Creative Product Photographer adheres to established elevated standards and shooting techniques to... 

augmentjobs

Urban Planning Consultant Job at augmentjobs

 ...Job Description Job Description We are seeking a talented and experienced Urban Planning Consultant to join our team. As an Urban Planning Consultant, you will play a key role in shaping sustainable urban development projects and policies. You will work collaboratively... 

Schneider

Owner-operator Tanker truck driver Job at Schneider

 ...Current annual revenue potential for tanker owner-operators: + Self-dispatch: Pick your loads,...  ...+ Possess a valid Class A Commercial Driver's License. + Have both a Tanker endorsement...  ...the following tractor requirements: + Truck(s) must be 2010 or newer. + Truck(s)... 

Walmart, Inc.

(USA) Independent Optometrist- Sam's Club. Cincinnati, OH. Job at Walmart, Inc.

 ...What you'll do... Launch your services in Sam's Club! As an Independent Optometrist leasing space inside Sam's Club, you will take a leading role in patient care with respect to eye and vision care as well as general health and well-being. As an inde Optometrist, General... 

Staffworks CNY

Quality Assurance Manager Job at Staffworks CNY

 ...Job Description Job Description We are seeking a Quality Assurance Manager to become an integral part of our team! Salary $60,000 Hours...  ...inventories, and planning production Responsibilities: Food Safety Program Manager Documentation Training / Team...