AP

Remote GenAI Data Automation Engineer

Job summary

Gaithersburg
Engineering

Work model

Remote first
Only United States
5 days ago
Job description

Job#: 3038066

Role Overview

We are seeking a Data Automation Engineer to design and implement innovative, AI-driven automation solutions across AWS and Azure hybrid environments. You will be responsible for building intelligent, scalable data pipelines and automations that integrate cloud services, enterprise tools, and Generative AI to support mission-critical analytics, reporting, and customer engagement platforms. The ideal candidate is mission-focused, delivery-oriented, and applies critical thinking to create innovative functions and solve technical issues.

Key Responsibilities

  • Design and maintain data pipelines in AWS using S3, RDS/SQL Server, Glue, Lambda, EMR, DynamoDB, and Step Functions.
  • Develop ETL/ELT processes to move data from multiple data systems including DynamoDB to SQL Server (AWS) and between AWS and Azure SQL systems.
  • Integrate AWS Connect CRM data into the enterprise data pipeline for analytics and operational reporting.
  • Engineer and enhance ingestion pipelines with Apache Spark, Flume, and Kafka for real-time and batch processing into Apache Solr and AWS Open Search platforms.
  • Leverage Generative AI services and frameworks to create automated processes for vector generation, enhance data quality, and build conversational BI interfaces.
  • Develop AI-powered copilots for pipeline monitoring and automated troubleshooting.
  • Implement SQL Server stored procedures, indexing, query optimization, profiling, and execution plan tuning to maximize performance.
  • Apply CI/CD best practices using GitHub, Jenkins, or Azure DevOps for both data pipelines and GenAI model integration.
  • Ensure security and compliance through IAM, KMS encryption, VPC isolation, RBAC, and firewalls.
  • Support Agile DevOps processes with sprint-based delivery of pipeline and AI-enabled features.

Required Qualifications

  • BS in Computer Science or a related field.
  • 2+ years of data engineering and automation experience.
  • Hands-on experience with SQL, SSIS, Python, Spark, Bash, PowerShell, and AWS/Azure CLIs.
  • Experience with AWS services like S3, RDS/SQL Server, Glue, Lambda, EMR, and DynamoDB.
  • Familiarity with Apache Flume, Kafka, and Solr for large-scale data ingestion and search.
  • Familiarity with LLM and Gen AI frameworks using AWS Bedrock, Azure OpenAI, or open-source platforms and tools.
  • Experience with integrating REST API calls in data pipelines and workflows.
  • Familiarity with JIRA, GitHub / Azure DevOps / Jenkins for SDLC and CI/CD automation.
  • Strong troubleshooting and performance optimization skills in SQL, Spark, or other data engineering solutions.
  • Experience operationalizing Generative AI (GenAI Ops) pipelines, including model deployment, monitoring, retraining, and lifecycle management for LLMs and AI-enabled data workflows.
  • Good communication and presentation skills.

Preferred Qualifications

  • Certifications: AWS Data Engineer, AWS AI/ML Specialty, Azure AI Engineer, Databricks Certified Data Engineer.
  • Experience implementing RAG pipelines, embeddings, and vector search with Solr, OpenSearch, FAISS, Pinecone, or Pgvector/SQL server vector types.
  • Experience with GenAI powered coding tools such as Claude Code, OpenAI Codex, VS Code.
  • Experience with multi-cloud data integration (AWS to Azure SQL).
  • Familiarity with Microsoft BizTalk and SSIS for SQL Server ETL workflows.
  • Knowledge of data lineage/governance tools (Purview, Unity Catalog, AWS Glue Catalog).
  • Familiarity with Infrastructure-as-Code (Terraform/CloudFormation, Bicep) for automated deployments.
  • Experience with compliance frameworks (FedRAMP, PCI-DSS, HIPAA).

PLEASE NOTE: Candidates must be able to obtain and/or maintain a Public Trust clearance as a condition and continuation of employment.

Work Environment

This is a fully remote, teleworking position. Quarterly travel to the Gaithersburg, MD area for team activities may be required.

Company Overview & Culture

Our organization is a Fortune 500 technology, engineering, and science solutions and services leader working to solve the world's toughest challenges in the defense, intelligence, civil, and health markets. We are trusted partners to both government and highly regulated commercial customers looking for transformative solutions in mission IT, security, software, engineering, and operations. Our civil group helps the government modernize operations with leading-edge AI/ML driven data management and analytics solutions.

Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package.

Everforth Apex uses a virtual recruiter as part of the application process. Click for more details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex and its affiliates, and contracted partners.

Everforth Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex, age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law.