Data Engineering Operator in Herndon, VA at Booz Allen Hamilton Inc.

Date Posted: 7/30/2018

Job Snapshot

Job Description

Job Number: R0033654

Data Engineering Operator

Key Role:

Deploy, monitor, and manage data pipelines built using StreamSets and other Big Data tools in support of a cutting-edge Big Data platform that is revolutionizing the way a large number of DoD clients operate. Maintain primary responsibility for the management of all pipelines in production, including the deployment of new pipelines, decommission of old pipelines, monitoring constantly active pipelines, optimizing pipeline performance, tweaking pipeline configurations, as needed, tagging and labelling pipelines, and identifying ways to implement new tools and processes to improve the platform. Use data engineering best practices combined with innovation to build new pipelines addressing new requirements of data acquisition, preparation and transformation, and analytics for data that can range from megabytes to over 200 GBs. Work with a multi-disciplinary team of analysts, data engineers, data scientists, developers, and data consumers in an agile fast-paced environment that is pushing the envelope of bleeding edge Big Data implementations.

Basic Qualifications:

-1+ years of experience with developing ETL pipelines and developing data manipulation scripts

-1+ years of experience in working with modern relational databases, including MySQL or PostgreSQL

-1+ years of experience with Big Data systems, including Hadoop, HDFS, and Hive

-Secret clearance

Additional Qualifications:

-Experience in working with enterprise and production systems

-Experience with Agile software development

-Possession of excellent writing skills

-Possession of excellent oral and written communication skills

-BS degree in CS, Information Systems, Information Systems, or a related field

-Hortonworks, Cloudera, or Big Data Certification


Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; Secret clearance is required.

We’re an EOE that empowers our people—no matter their race, color, religion, sex, gender identity, sexual orientation, national origin, disability, or veteran status—to fearlessly drive change.


Your Career is Waiting.

Get job alerts. Learn about new work and upcoming events. Share open roles with friends and colleagues.
Our Talent Network is your opportunity hub.

Get Answers and Access.

Need more information? Find it in our FAQs.

Application already in-process? Log in to keep going.