Data Engineer (Data Architecture & Engineering)
Washington, DC
Full Time
Experienced
Required Qualifications, Education, and Experience:
- Active TS/SCI clearance
- Bachelor’s degree or equivalent practical experience.
- Expertise in distributed computing frameworks to handle large-scale data processing.
- Familiarity working with Amazon Web Managed Services (AWS) or any other cloud environments.
- Working experience with datastores like PostgreSQL, S3, Redshift, MongoDB/DynamoDB, Redis, Elasticsearch/OpenSearch and SQL.
- Proficient utilizing Python with key libraries like pandas and PySark, NiFi, Airflow, AWS Lambda or similar technologies.
- Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS and Kafka.
- Familiar with Linux/Unix server environments.
- Experience with Agile development methodology.
- Publishing and/or presenting design reports.
- Coordinating with other team members to reach project milestones and deadlines.
- Working knowledge with Collaboration tools, such as, Jira and Confluence
Desired Qualifications, Education, and Experience:
- Master’s degree or equivalent experience in a related field.
- Familiarity and experience with the Intelligence Community (IC), and the intel cycle.
- Familiarity and experience with the Department of Homeland Security (DHS).
- Direct Experience with DHS and Intelligence Community (IC) component's data architectures and environments (IC-GovCloud experience preferred).
- Experience with cloud message APIs and usage of push notifications.
- Keen interest in learning and using the latest software tools, methods, and technologies to solve real world problem sets vital to national security.
- Working knowledge with public keys and digital certificates.
- Experience with DevOps environments.
- Expertise in various COTS, GOTS, and open source tools which support development of data integration and visualization applications.
- Experience with cloud message APIs and usage of push notifications.
- Specialization in Object Oriented Programming languages, scripting, and databases
Apply for this position
Required*