Azure Data Platform Engineer -Bangalore

Job Description Design and Implement Data Solutions: Lead the design, development, and implementation of scalable and secure Azure- based data platforms, ensuring integration with various data sources and business systems. Deliver at least 2 major projects every year with a focus on data engineering best practices.  Optimize Data Pipelines: Build and optimize end-to-end data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse, with an emphasis on automating data workflows. Achieve a 20% reduction in pipeline execution times Public within the first 6 months.  Cloud Infrastructure Management: Manage and maintain the Azure data environment, ensuring high availability, disaster recovery, and cost optimization. Track and improve system uptime to exceed 99.9% reliability.  Collaborate with Cross-Functional Teams: Partner with data scientists, data analysts, and business stakeholders to translate business requirements into efficient data solutions. Facilitate at least 3 collaborative sessions per quarter to address key business use cases.  Ensure Data Security & Compliance: Implement data security measures, ensuring compliance with industry regulations (GDPR, HIPAA, etc.) and company policies. Achieve and maintain full compliance in all data environments within the first quarter of onboarding.  Continuous Learning & Knowledge Sharing: Stay up-to-date with emerging Azure technologies, and mentor junior engineers to promote knowledge sharing. Complete 1 Azure certification annually and conduct at least 2 internal knowledge-sharing sessions per year.  Sound knowledge of data governance practices, data quality management, and data security principles.  Play a pivotal role in shaping our organization's data-driven journey, driving innovation through data analytics and insights.  Optimize data storage, processing and retrieval mechanisms for performance, cost, and scalability using data storage services (such as Azure Data Lake Storage, Azure SQL Database, etc.), data processing services (such as Azure Data Bricks, Azure Synapse, etc.) and data visualization (PowerBI, Qlik, etc.) & integration services (Data API builder, logic apps, etc.)  Monitor and troubleshoot data platform performance, identify and resolve issues, and provide recommendations for continuous improvement.  Collaborate with DevOps teams to automate deployment, configuration, and monitoring processes using Azure DevOps, PowerShell, or other relevant tools.  Stay up to date with the latest trends and advancements in cloud data services and provide recommendations on adopting new technologies or features to enhance the data platform.  Document technical designs, procedures, and guidelines for data platform engineering and operations Knowledge, Skills & Experience Job Experience  Bachelor's degree in Computer Science, Engineering, or a related field. Advanced degree preferred.  Proven 6-10 years experience in playing platform engineer or admin role  Experience with big data technologies such as Apache Spark, Hadoop, or similar frameworks.  Solid understanding of cloud computing concepts and experience with cloud infrastructure management and provisioning.  Solid understanding of network security concepts and technologies (such as firewalls, VPNs, intrusion detection/prevention systems, etc.) and data security concepts and technologies (such as access controls, encryption, observability, privacy laws/regulations, etc.)  Experience in a Retail setup is preferred. Required Skills The position will require someone with the following:  Strategic Planning  Communication and Collaboration  Problem Solving Skills A/B testing & experimentation