Databricks Developer

Project description You will be working in a global team that manages and performs a global technical control. You'll be joining Assets Management team which is looking after asset management data foundation and operates a set of in-house developed tooling. As an IT engineer you'll play an important role in ensuring the development methodology is followed, and lead technical design discussions with the architects. Our culture centers around partnership with our businesses, transparency, accountability and empowerment, and passion for the future. Responsibilities Design, build, and manage data pipelines using Azure Data Integration Services (Azure DataBricks, ADF, Azure Functions.) Collaborate closely with the security team to develop robust data solutions that support our security initiatives. Implement, monitor, and optimize data processes, ensuring adherence to security and data governance best practices. Troubleshoot and resolve data-related issues, ensuring data quality and accessibility. Develop strategies for data acquisitions and integration of the new data into our existing architecture. Document procedures and workflows associated with data pipelines, contributing to best practices. Share knowledge about latest Azure Data Integration Services trends and techniques. Implement and manage CI/CD pipelines to automate data and UI testcases and integrate testing with development pipelines. Implement and manage CI/CD pipelines to automate development and integrate test pipelines. Conduct regular reviews of the system, identify possible security risks, and implement preventive measures. Skills Must have Excellent command of English Bachelor's or Master's degree in Computer Science, Information Technology, or related field. 5 years of experience in data integration and pipeline development using Azure Data Integration Services including Azure Data Factory and Azure Databricks. Hands-on with Python and Spark Strong understanding of security principles in the context of data integration. Proven experience with SQL and other data query languages. Ability to write, debug, and optimize data transformations and datasets. Extensive experience in designing and implementing ETL solutions using Azure Databricks, Azure Data Factory or similar technologies. Familiar with automated testing frameworks using Squash Nice to have Data Architecture & Engineering: Design and implement efficient and scalable data warehousing solutions using Azure Databricks and Microsoft Fabric. Business Intelligence & Data Visualization: Create insightful Power BI dashboards to help drive business decisions.

Location: pune, IN

Posted Date: 6/18/2025