Job Description

• Data Engineer with Pyspark, Databricks skillset 8+ years of experience Data Engineering with min 5+ years hands on experience in Pyspark for data transformations.
• Sound Knowledge on - Azure Data Bricks, Azure Data Lake.
• Sound knowledge in Data Bricks & Logic Apps
• Delta Lake, Azure SQL and Azure blob storage, Azure logic apps, Azure Functions and Azure Synapse, Azure Purview.
• Extensive knowledge on big data concepts like Hive, and spark framework.
• Should be able to write complex SQL queries. Sound understanding of DWH concepts.
• Strong hands-on experience on Python or Scala.
• Hands on experience on Azure Data Factory.
• Should be able to coordinate independently with business stake holders and understand the business requirements.
• Knowledge on DevOps and Agile methodologies-based projects, implement the requirements using ADF/Data Brick
• Knowledge of version control tool such as Git/Bitbucket.
• Should have basic understanding on Batch Account configuration, various control and monitoring options.