W-2 Jobs Portal

  • W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.
Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters

Job Overview

  • Job ID:

    J36993

  • Specialized Area:

    Hadoop

  • Job Title:

    Hadoop developer

  • Location:

    Pleasanton,CA

  • Duration:

    12 Months

  • Domain Exposure:

    IT/Software

  • Work Authorization:

    US Citizen, Green Card, OPT-EAD, CPT, H-1B,
    H4-EAD, L2-EAD, GC-EAD

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2 (Consultant must be on our company payroll. C2C is not allowed)




Job Description

Job Description:

Deliverables:
The tasks for the Hadoop/Machine Learning Engineer include, but are not limited to, the following:

  • Provide technical leadership, develop vision, gather requirements and translate client user requirements into technical architecture.
  • Design, build and scale Machine Learning systems across multiple domains.
  • Design and implement an integrated Big Data platform and analytics solution
  • Design and implement data collectors to collect and transport data to the Big Data Platform.

 
Technical Knowledge and Skills:
Consultant resources shall possess most of the following technical knowledge and experience:

  • Provide technical leadership, develop vision, gather requirements and translate client user requirements into technical architecture.
  • Strong Hands-on Experience in building, deploying and productionizing ML models using software such as Spark MLLib, TensorFlow, PyTorch, Python Scikit-learn etc. is mandatory
  • Ability to evaluate and choose best suited ML algorithms, perform feature engineering and optimize Machine Learning Models is mandatory
  • Strong fundamentals in algorithms, data structures, statistics, predictive modeling, & distributed systems is must
  • Design and implement an integrated Big Data platform and analytics solution
  • Design and implement data collectors to collect and transport data to the Big Data Platform.
  • 4+ years of hands-on Development, Deployment and production Support experience in Hadoop environment.
  • 4-5 years of programming experience in Java, Scala, Python. 
  • Proficient in SQL and relational database design and methods for data retrieval.
  • Knowledge of NoSQL systems like HBase or Cassandra
  • Hands-on experience in Cloudera Distribution 5.x
  • Hands-on experience in creating, indexing Solr collections in Solr Cloud environment.
  • Hands-on experience building data pipelines using Hadoop components Sqoop, Hive, Pig, Solr, MR, Spark, Spark SQL.
  • Must have experience with developing Hive QL, UDF’s for analyzing semi structured/structured datasets.
  • Must have experience with Spring framework
  • Hands-on experience ingesting and processing various file formats like Avro/Parquet/Sequence Files/Text Files etc.
  • Hands-on experience working in Real-Time analytics like Spark/Kafka/Storm
  • Experience with Graph Databases like Neo4J, Tiger Graph, Orient DB
  • Must have working experience in the data warehousing and Business Intelligence systems.
  • Expertise in Unix/Linux environment in writing scripts and schedule/execute jobs.
  • Successful track record of building automation scripts/code using Java, Bash, Python etc. and experience in production support issue resolution process.
  • Experience with R, Jupyter/Zeppelin 

Apply Now
Equal Opportunity Employer

QUANTUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. QUANTUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will QUANTUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract