Data Engineer Rekindle
Bangalore, Karnataka, India Full-time Technology & Engineering
- Data engineer with 7 to 8 years of experience into development of data pipelines using Azure stack
- Deep Microsoft Azure product knowledge and understanding of product features, with exposure to other cloud solutions (Google, AWS) a plus
- Good communication skills
- Stakeholder management
- Good coding and programming skills using python/ PySpark
- Good knowledge in data structures and algorithms
- Very strong hands-on experience in using Microsoft Azure services like Azure Data Factory, Data brick services (like processing streaming data using Spark clusters), usage of Blob containers, ESB, Event Grid, Azure SQL server, Cosmos DB, Azure functions, Azure synapse and is a mandatory requirement.
- Good understanding in creating data models.
- Hands on in to Denodo VDB , creation of views and data virtualization concepts.
- Excellent understanding of architecture patterns and best practices with proven innovative and leading-edge thinking to build cloud-ready systems (e.g., Domain Driven Architecture, multi-tenancy, building for resilience, scalability, performance, and federation, microservices etc.)
- Understanding of big data platforms concepts and NoSQL technologies, and ability to map such
- Should have experience in modeling data for traditional structured data, as well as information design in Data Lake and NoSQL database engines.
- Understands industry recognized data modelling patterns and standards
- Proven track record in designing, developing and implementing data modelling, at a conceptual, logical and physical level.
- Knowledge of the latest technologies to process large amount of data (Apache Spark; Databricks is a plus)
- Experience in Data Quality and Data Lineage tools.
- Expertise in cloud security and identity best practices
- A deep understanding of ETL and ELT tools and techniques
- Having pharma and regulatory domain knowledge would be an added value.
- Education: Engineering, MCA, M. Tech
- Primary skill : Azure Data Lake Gen1/Gen2, Azure Data factory v2, Azure Data bricks, Azure DWH, Azure Synapse, Key vault, Azure Active directory
- DataBase: Snowflake, Azure synapse
- Programing Language: pyspark, SQL , Python