[Remote] Data Engineer – Databricks/ Snowflake / Iceberg Migration ( w2 role)

Job summary

United States
Software Developer

Work model

Fully remote
Only United States
5 days ago
Job description

Job Overview

CloudIngest is seeking a Data Engineer / Data Architect to lead the migration of Snowflake datasets to Databricks Unity Catalog-managed Iceberg tables. This remote role, open to candidates in the USA, focuses on ensuring a smooth transition and maintaining cross-platform data accessibility while supporting advanced analytics and AI-driven workloads.

Responsibilities

  • Lead and execute the migration of Snowflake tables to Databricks Unity Catalog (Iceberg format)
  • Assess existing Snowflake data models, pipelines, and dependencies
  • Establish dual-access capabilities (Snowflake external access and Databricks)
  • Identify and convert queries to Spark SQL-compatible syntax
  • Work closely with data platform and datahub teams to ensure seamless onboarding
  • Perform data validation, reconciliation, and consistency checks post-migration
  • Enhance and optimize data pipelines and query performance in Databricks
  • Ensure adherence to data governance, access control, and Unity Catalog best practices
  • Troubleshoot and resolve migration-related issues efficiently
  • Develop and contribute to automation frameworks and reusable migration components

Skills

  • Strong expertise in Snowflake and Databricks (Spark, Unity Catalog)
  • Hands-on experience with Apache Iceberg, Delta Lake, or other open table formats
  • Proficiency in SQL and Spark SQL
  • Experience in data migration, ETL/ELT processes, and data modeling
  • Familiarity with AWS (S3, IAM, networking) or equivalent cloud environments
  • Solid understanding of data governance and access management
  • Ability to troubleshoot and optimize performance across distributed systems
  • Experience with cross-platform data sharing (Snowflake + Databricks)
  • Knowledge of REST catalog integration and Iceberg external tables
  • Exposure to AI/BI workloads and analytics ecosystems
  • Understanding of enterprise data platforms and data mesh architecture

Company Overview

CloudIngest offers software development, digital Transformations, business intelligence, and cloud services. Founded in undefined, it is headquartered in Alpharetta, Georgia, USA, with a workforce of 11-50 employees.

Company Sponsorship Information

CloudIngest has a track record of offering H1B sponsorships, with 7 in 2025, 9 in 2024, 13 in 2023, 6 in 2022, 2 in 2021, and 6 in 2020. Please note that this does not guarantee sponsorship for this specific role.

Website: https://cloudingest.com