Senior dataiku Develope

Job Description -- Senior Dataiku Developer (6--9 Years Experience)

Experience: 6--9 Years

Location: Remote

Salary: ₹15--16 LPA (or as per company standards)

Work Hours: Overlap with UK/US business hours

Role Overview

We are looking for a Senior Dataiku Developer with 6--9 years of experience in data engineering, ETL development, and analytics platforms, including strong hands-on expertise in Dataiku DSS. The ideal candidate will design, develop, and optimize scalable data pipelines, implement robust data quality frameworks, and deliver governed data solutions that support enterprise reporting and analytics.

Key ResponsibilitiesDataiku Development & Pipeline Engineering

• Design, develop, and maintain metadata-driven data ingestion pipelines using Dataiku DSS.
• Build and optimize ETL/ELT workflows for structured, semi-structured, and unstructured data sources such as databases, CSV/Excel, XML, JSON, APIs, PDFs, images, and email attachments.
• Develop Python and PySpark recipes for data parsing, cleansing, transformation, enrichment, and standardization.
• Convert legacy Microsoft Access queries, SQL scripts, and Excel/VBA logic into scalable, governed Dataiku workflows.
• Develop reusable Dataiku components, plugins, and project templates to improve development efficiency.
• Load and maintain Bronze, Silver, and Gold data layers in PostgreSQL/Amazon RDS environments.

Data Quality & Governance

• Implement Dataiku Data Quality rules to ensure data completeness, validity, consistency, reconciliation, and anomaly detection.
• Build audit-ready data pipelines with logging, run history, snapshots, and reproducible processing.
• Follow enterprise security standards, including role-based access control (RBAC), least-privilege principles, and secure secrets management.
• Maintain documentation for data lineage, transformation logic, and business rules.

Workflow Automation & Reporting

• Develop Dataiku Scenarios for workflow orchestration, scheduling, monitoring, and alerting.
• Build Dataiku WebApps for business users to manage exceptions and approval workflows.
• Integrate Dataiku with Power Automate, REST APIs, and external enterprise applications where required.
• Support Power BI reporting by delivering curated and governed datasets.

Collaboration & Delivery

• Work in Agile/Scrum teams to deliver high-quality data engineering solutions.
• Participate in code reviews, Git-based version control, CI/CD, and release management.
• Collaborate with business stakeholders, architects, data analysts, and cross-functional teams across UK/US time zones.
• Troubleshoot production issues and continuously optimize pipeline performance.

Required Skills

• 6--9 years of experience in Data Engineering or ETL Development.
• 3 years of hands-on experience with Dataiku DSS.
• Strong expertise in Python , PySpark, and SQL.
• Experience with PostgreSQL, Amazon RDS, or similar relational databases.
• Experience building scalable ETL/ELT pipelines and workflow automation.
• Strong understanding of data quality, governance, metadata management, and data lineage.
• Experience with Git, CI/CD, and Agile development methodologies.
• Good knowledge of REST APIs and data integration techniques.
• Excellent analytical, problem-solving, and communication skills.

Preferred Qualifications

• Experience with AWS data services.
• Exposure to Power BI and Power Automate.
• Experience working with OCR, document processing, or unstructured data.
• Knowledge of enterprise security and compliance frameworks (SOX, audit, governance).
• Dataiku certifications are an added advantage.

Nice to Have

• Experience developing Dataiku plugins or reusable frameworks.
• Familiarity with Spark optimization and large-scale data processing.
• Experience supporting global delivery teams with UK/US stakeholders.

Job Description -- Senior Dataiku Developer (6--9 Years Experience)

Experience: 6--9 Years

Location: Remote

Salary: ₹15--16 LPA (or as per company standards)

Work Hours: Overlap with UK/US business hours

Role Overview

We are looking for a Senior Dataiku Developer with 6--9 years of experience in data engineering, ETL development, and analytics platforms, including strong hands-on expertise in Dataiku DSS. The ideal candidate will design, develop, and optimize scalable data pipelines, implement robust data quality frameworks, and deliver governed data solutions that support enterprise reporting and analytics.

Key ResponsibilitiesDataiku Development & Pipeline Engineering

• Design, develop, and maintain metadata-driven data ingestion pipelines using Dataiku DSS.
• Build and optimize ETL/ELT workflows for structured, semi-structured, and unstructured data sources such as databases, CSV/Excel, XML, JSON, APIs, PDFs, images, and email attachments.
• Develop Python and PySpark recipes for data parsing, cleansing, transformation, enrichment, and standardization.
• Convert legacy Microsoft Access queries, SQL scripts, and Excel/VBA logic into scalable, governed Dataiku workflows.
• Develop reusable Dataiku components, plugins, and project templates to improve development efficiency.
• Load and maintain Bronze, Silver, and Gold data layers in PostgreSQL/Amazon RDS environments.

Data Quality & Governance

• Implement Dataiku Data Quality rules to ensure data completeness, validity, consistency, reconciliation, and anomaly detection.
• Build audit-ready data pipelines with logging, run history, snapshots, and reproducible processing.
• Follow enterprise security standards, including role-based access control (RBAC), least-privilege principles, and secure secrets management.
• Maintain documentation for data lineage, transformation logic, and business rules.

Workflow Automation & Reporting

• Develop Dataiku Scenarios for workflow orchestration, scheduling, monitoring, and alerting.
• Build Dataiku WebApps for business users to manage exceptions and approval workflows.
• Integrate Dataiku with Power Automate, REST APIs, and external enterprise applications where required.
• Support Power BI reporting by delivering curated and governed datasets.

Collaboration & Delivery

• Work in Agile/Scrum teams to deliver high-quality data engineering solutions.
• Participate in code reviews, Git-based version control, CI/CD, and release management.
• Collaborate with business stakeholders, architects, data analysts, and cross-functional teams across UK/US time zones.
• Troubleshoot production issues and continuously optimize pipeline performance.

Required Skills

• 6--9 years of experience in Data Engineering or ETL Development.
• 3 years of hands-on experience with Dataiku DSS.
• Strong expertise in Python , PySpark, and SQL.
• Experience with PostgreSQL, Amazon RDS, or similar relational databases.
• Experience building scalable ETL/ELT pipelines and workflow automation.
• Strong understanding of data quality, governance, metadata management, and data lineage.
• Experience with Git, CI/CD, and Agile development methodologies.
• Good knowledge of REST APIs and data integration techniques.
• Excellent analytical, problem-solving, and communication skills.

Preferred Qualifications

• Experience with AWS data services.
• Exposure to Power BI and Power Automate.
• Experience working with OCR, document processing, or unstructured data.
• Knowledge of enterprise security and compliance frameworks (SOX, audit, governance).
• Dataiku certifications are an added advantage.

Nice to Have

• Experience developing Dataiku plugins or reusable frameworks.
• Familiarity with Spark optimization and large-scale data processing.
• Experience supporting global delivery teams with UK/US stakeholders.

Tips: Provide a summary of the role, what success in the position looks like, and how this role fits into the organization overall.

Responsibilities

[Be specific when describing each of the responsibilities. Use gender-neutral, inclusive language.]

Example: Determine and develop user requirements for systems in production, to ensure maximum usability

Qualifications

[Some qualifications you may want to include are Skills, Education, Experience, or Certifications.]

Example: Excellent verbal and written communication skills