W-2 Jobs Portal

  • W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.
Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters

Job Overview

  • Job ID:

    J36993

  • Specialized Area:

    Hadoop & Big Data

  • Job Title:

    Big Data Engineer

  • Location:

    Detroit,MI

  • Duration:

    10 Months

  • Domain Exposure:

    Healthcare, Utilities/ Energy, IT/Software

  • Work Authorization:

    US Citizen, Green Card, OPT-EAD, CPT, H-1B,
    H4-EAD, L2-EAD, GC-EAD

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2 (Consultant must be on our company payroll. C2C is not allowed)




Job Description

 Responsibilities

  • Develop ELT processes from various data repositories and APIs across the enterprise, ensuring data quality and process efficiency
  • Develop data processing scripts using Spark
  • Develop relational and NoSQL data models to help conform data to meet users’ needs using Hive and HBase
  • Integrate platform into the existing enterprise data warehouse and various operational systems
  • Develop administration processes to monitor cluster performance, resource usage, backup and mirroring to ensure a highly available platform
  • Address performance and scalability issues in a large-scale data lake environment
  • Provide big data platform support and issue resolutions to Data Scientists and fellow engineers

Requirements

  • Master's degree in computer science, software engineering or a closely related field
  • 2 years of experience with Hadoop distribution and ecosystem tools such as Hive, Spark, NiFi and Oozie
  • 2 years of experience developing batch and streaming ETL processes
  • 2 years of experience with relational and NoSQL databases, including modeling and writing complex queries
  • Proficiency in at least one programming language, such as Python or Java
  • Experience with Linux system administration, scripting and basic network skills
  • Excellent communication, analytical and problem-solving skills

Apply Now
Equal Opportunity Employer

QUANTUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. QUANTUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will QUANTUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract