Data Engineer, Senior

Key Role:

Support the development and maintenance of scalable data stores that supply big data in forms needed for business analysis. Apply advanced consulting skills and extensive technical expertise and full industry knowledge. Develop innovative solutions to complex problems. Work without considerable direction. Mentors and supervise team members.

Basic Qualifications:

  • 5+ years of experience with database design and development

  • Experience with streaming tools

  • Experience in working with a database using SQL or Hadoop Big Data Ecosystem

  • Experience with scaling big data jobs for data ingestion

  • Experience with managing data across relational SQL and NoSQL databases, including MySQL, Postgres, Cassandra, or HDFS

  • Experience with working in a Linux environment, designing REST APIs, designing and developing platform components, including caching, messaging, event processing, automation, transformation, and tooling frameworks

  • Ability to obtain a security clearance

  • BA or BS degree

Additional Qualifications:

  • Experience with building both batch and real-time data pipelines and interfaces

  • Experience in developing data ingest workflows with stream-processing systems such as Spark-Streaming, Kafka Streams, or Flink

  • Experience with transforming data in various formats, including JSON, XML, CSV, or zipped files

  • Experience with performance tuning of ETL jobs

  • Experience with developing flexible ontologies to fit data from multiple sources and implementing the ontology in the form of database mappings or schemas

  • Experience with Microservices architecture components, including Docker or Kubernetes

  • Experience with AWS cloud services, including EC2, S3, EMR, RDS, Redshift, Athena or Glue

  • Knowledge of security and best practices

  • MA or MS degree in Computer Science, Engineering, Statistics, Mathematics, or Data Science

Clearance:

Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information.

We’re an EOE that empowers our people—no matter their race, color, religion, sex, gender identity, sexual orientation, national origin, disability, veteran status, or other protected characteristic—to fearlessly drive change.

#LI-AH1

Not ready to apply? Join our talent community and sign up for job alerts.