- W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.
Job ID:
J36993
Specialized Area:
Hadoop & Big Data
Job Title:
Big Data & Hadoop Engineer
Location:
Jersey City,NJ
Duration:
9 Months
Domain Exposure:
Banking & Finance, Government, IT/Software
Work Authorization:
US Citizen, Green Card, OPT-EAD, CPT, H-1B,
H4-EAD, L2-EAD, GC-EADClient:
To Be Discussed Later
Employment Type:
W-2 (Consultant must be on our company payroll. C2C is not allowed)
Key Accountabilities:
- Responsible for implementation, ongoing administration and technical support of Hadoop eco-system (including access, incident and problem management).
- Provide technical leadership and collaborate with developers and architects for implementations on the Hadoop Platform.
- Configuration and maintenance of the Hadoop Platform and various associated components (including 3rd party tools) for data ingestion, transformation, migration, processing and reporting.
- Cluster maintenance as well as creation and removal of nodes, patching, upgrades and installations (Cloudera or equivalent platform, 3rd party components within Hadoop Eco-System).
- Diligently teaming with the infrastructure, network, database, application and business intelligence teams to achieve high data quality, performance, availability and security of the platform.
- Mentor other Hadoop developers and administrators.
- Lead and manage vendor staff delivery for Hadoop Platform.
- Work with vendor support teams for support and maintenance of the platform
- Help optimize and integrate new infrastructure via continuous integration methodologies.
- Provide and maintain documentation for processes and platform.
Experience:
- 4+ years of enterprise Big Data platform administration experience using Hadoop (Cloudera or equivalent).
- Enterprise big data security and management operations using tools / services such as Sentry and Kerberos
- Exposure to the Hadoop ecosystem [Cloudera distribution]. Exposure to components such as HDFS, Spark, Sqoop, Oozie, Flume, Hive, Impala, MapReduce, Sentry, Navigator.
- Experienced in configuration of 3rd party systems such as Informatica Big Data Edition / Arcadia / Trifacta / Attunity preferred
- Experience working on Unix / Linux environment, as well as Windows environment
- Experience on Java or Scala or Python in addition to exposure to creating shell scripts for automating tasks / housekeeping
- Prior experience of tuning, analysis and monitoring of the platform, and coming up with recommendations for optimizations
- Experience in providing and maintaining technical and process documentation.
- Experience in debugging, troubleshooting and analyzing production issues
- Experience on Continuous Integration preferred
- Experience on large scale (>1TB raw) data processing and ETL preferred
Apply Now
QUANTUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. QUANTUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will QUANTUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract