Lead Data Engineer- Governance

Bangalore, Karnataka, India Full-time Retail & E-commerce Lead / Principal

About This Opportunity Responsibilities:

  • Lead the design, implementation, and continuous improvement of enterprise-wide data quality frameworks, standards, and best practices.
  • Define, monitor, and report on data quality KPIs, scorecards, and SLAs to measure data health across critical business domains.
  • Develop and maintain automated data quality checks, validation rules, reconciliation processes, and exception reporting frameworks.
  • Perform data profiling, anomaly detection, root-cause analysis, and impact assessments to identify and resolve data quality issues.
  • Write and optimize complex SQL queries to analyze, validate, and reconcile large and complex datasets across multiple source systems.
  • Develop Python-based automation solutions to streamline data validation, monitoring, reconciliation, and issue remediation processes.
  • Leverage AI/ML techniques and statistical methods to detect data anomalies, predict quality issues, and improve data observability.
  • Partner with Data Engineering teams to embed data quality controls within ETL/ELT pipelines and data transformation processes.
  • Collaborate with Data Governance, Business, and Technology teams to define critical data elements, business rules, and quality standards.
  • Ensure data integrity, consistency, completeness, accuracy, and timeliness across enterprise data platforms and reporting environments.
  • Support metadata management, data lineage, and data catalog initiatives to improve transparency and traceability of data assets.
  • Design and maintain dashboards, scorecards, and AI-enabled monitoring solutions that provide visibility into data quality performance, trends, and risks.
  • Lead investigations of data incidents, coordinate remediation efforts, and implement preventive controls to reduce recurring issues.
  • Mentor and guide analysts on data quality methodologies, Python programming, automation techniques, AI-driven analytics, and technical best practices.
  • Drive continuous improvement by identifying opportunities to leverage Generative AI, machine learning, and intelligent automation to enhance data quality processes and operational efficiency.

Educational & Required Qualifications:

  • Bachelor's degree in Computer Science, Information Systems, Data Analytics, Statistics, Mathematics, Engineering, or a related quantitative field.
  • Minimum 7+ years of experience in Data Analytics, Data Quality, Data Governance, Business Intelligence, or related disciplines.
  • Proven experience leading data quality initiatives, projects, or teams within complex enterprise environments.
  • Advanced proficiency in SQL with hands-on experience querying, validating, reconciling, and analyzing large-scale datasets.
  • Strong programming skills in Python with experience developing automation solutions, data validation frameworks, APIs, and analytical workflows.
  • Experience applying AI/ML techniques, statistical analysis, or anomaly detection models to improve data quality, monitoring, and decision-making processes.
  • Experience working with modern cloud data platforms such as Databricks, Snowflake etc.
  • Solid understanding of data warehousing concepts, data modeling, ETL/ELT processes, data lifecycle management, and data governance principles.
  • Familiarity with Generative AI tools, AI-assisted analytics, automation frameworks, and modern data quality/observability platforms.
  • Excellent analytical, problem-solving, communication, stakeholder management, and cross-functional collaboration skills, with the ability to influence both business and technical teams.
  • Established data stewardship best practices and governance frameworks to improve data reliability.
  • Defined data ownership, stewardship responsibilities, and data quality standards across business units.
  • Automated data quality monitoring processes, reducing manual effort and improving data accuracy.
  • Partnered with data architects, data engineers, and business analysts to implement enterprise-wide governance solutions.

Preferred Technical Skills

  • SQL (Advanced)
  • Retail industry experience is preferred.
  • Python (Pandas, NumPy, PySpark, APIs, Automation Frameworks)
  • Data Quality & Observability Tools (Monte Carlo, Informatica DQ, etc.)
  • Power BI, Tableau, or similar BI platforms
  • Snowflake, Databricks, Azure, AWS, or GCP Data Services
  • Machine Learning & Anomaly Detection
  • Generative AI tools (Copilot, Windsurf, Codex, ChatGPT Enterprise, Azure OpenAI)
  • Git, CI/CD, and DevOps practices for analytics and automation solutions
Share
More open mandates

Related mandates

Full-time

Sr. Accountant/Process Lead - GL

Bangalore, Karnataka, India
View mandate
Full-time

Security Analyst

Bangalore, Karnataka, India
View mandate
Full-time

Team Lead-Customer Service

Bangalore, Karnataka, India
View mandate
Apply

Apply for this mandate

It takes about four minutes. You can complete your application without leaving this page.

Have your CV ready. It goes directly to the consultant leading this search.

Your application is handled with discretion.

Your full annual package (your CTC, in India), for example 1800000 or 18 LPA. If you are between roles, give your last one. Picked Other? Write the currency in with the amount.
On the same basis, for a move. A cross-border move often changes the currency, so set each one.
Attach your CV PDF, Word, RTF or text · up to 5 MB

Application received

Thank you for applying for this role.

As we receive many applications, we’re not able to reply to each one personally. If you’re shortlisted, the consultant running this search will be in touch. We do not share your details with any client before we speak to you.

Not ready to apply? Submit your profile for future and confidential mandates.

Let's build what's next.