- W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.
Job ID:
J36993
Specialized Area:
Hadoop
Job Title:
Senior Hadoop Administrator
Location:
Irving,TX
Duration:
10 Months
Domain Exposure:
Manufacturing, Banking & Finance, Utilities/ Energy
Work Authorization:
US Citizen, Green Card, OPT-EAD, CPT, H-1B,
H4-EAD, L2-EAD, GC-EADClient:
To Be Discussed Later
Employment Type:
W-2 (Consultant must be on our company payroll. C2C is not allowed)
Job Description:
What You Will Be Doing
* Responsible for implementation and ongoing administration of Hadoop infrastructure
* Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments
* Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, HBase and Yarn access for the new users
* Cluster maintenance as well as creation and removal of nodes using tools like Cloudera Manager Enterprise, etc.
* Performance tuning of Hadoop clusters and Hadoop MapReduce routines
* Screen Hadoop cluster job performances and capacity planning
* Monitor Hadoop cluster connectivity and security
* Manage and review Hadoop log files
* File system management and monitoring
* HDFS support and maintenance
* Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
* Collaborating with application teams to perform Hadoop updates, patches, version upgrades when required
* Work with Vendor support teams on support tasks
* General operational expertise such as good troubleshooting skills, understanding of system's capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks
* The most essential requirements are: They should be able to deploy Hadoop cluster, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability, schedule and configure it and take backups
* Solid Understanding on premise and Cloud network architectures
* Additional Hadoop skills like Sentry, Spark, Kafka, Oozie, etc
Preferred Skills
* Experience with Impala
* Kerberos administration skills
* Experience with Cloudera distribution
* Familiarity with open source configuration management and deployment tools such as Puppet or Chef and Shell scripting
* Familiarity with DevOps tools like Ansible, Nagios and HAProxy
* Knowledge of Troubleshooting Core Java Applications is a plus
* Proven track record in incorporating latest operational tools into big data platforms
What You Need for this Position
* Bachelor's in Computer Science or related discipline
* 5 years of Linux system administration
* 3 years of Hadoop infrastructure administration
* HortonWorks & MapR distributions will also be considered
Apply Now
QUANTUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. QUANTUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will QUANTUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract