Spear, Inc. Senior Hadoop Engineer in McLean, Virginia

Spear, Inc. is seeking a Senior Hadoop Engineer to join our team in McLean, VA! The Senior Hadoop Engineer will be responsible for the following:

  • Implementation and support of the EnterpriseHadoop environment.

  • Involves designing, capacity arrangement,cluster set up, performance fine-tuning, monitoring, structure planning,scaling and administration.

  • The candidate will routinely work closely withinfrastructure, network, database, business intelligence and application teamsto ensure business applications are highly available and performing withinagreed on service levels.

  • Need to implement concepts of Hadoop eco systemsuch as YARN, MapReduce, HDFS, HBase, Spark, Zookeeper, Pig and Hive.

  • Accountable for storage, performance tuning andvolume management of Hadoop clusters and MapReduce routines.

  • In command of setup, configuration and securityfor Hadoop clusters using Kerberos.

  • Monitor Hadoop cluster connectivity andperformance.

  • Manage and analyze Hadoop log files.

  • File system management and monitoring.

  • Develop and document best practices

  • HDFS support and maintenance.

  • Setting up new Hadoop users.

  • Responsible for the new and existingadministration of Hadoop infrastructure.


  • Top Secret Clearance with Polygraph

  • High School Diploma

  • 5 – 10 years applicable experience

  • Able to participate in on-call support rotationfor after-hours support.

  • Embrace a culture of continuous improvement andinnovation.

  • Excellent communication skills.

Desirable Skills

  • Linux background with experience kick starting new machines.

Spear, Inc. is an Equal Employment Opportunity employer.Qualified applicants will receive consideration for employment without regardfor race, color, religion, sex, sexual orientation, gender identity, nationalorigin, disability or protected veteran status.