Data Engineer

Key Responsibilities: Support the transition of portfolio analytics workflows from SAS to Databricks. Develop and optimize code using PySpark and Python within the Databricks environment. Tune performance and ensure scalability of Databricks jobs. Schedule and manage jobs in Databricks and orchestrate data pipelines. Utilize GitHub for version control and collaborate effectively with team members. Leverage Snowflake and Snowpark for high-performance querying across large datasets. Create and deliver training materials to mentor junior analysts. Work closely with cross-functional teams to ensure smooth data operations and delivery. Required Qualifications: 5–8 years of hands-on experience with Databricks workspace, notebooks, and job clusters. Proven expertise in PySpark and core Python libraries. In-depth knowledge of job scheduling in Databricks. Strong skills in performance tuning and code optimization. Experience with GitHub for version control. Ability to support and drive SAS-to-Databricks migration. Preferred Qualifications: Strong working knowledge of Snowflake and Snowpark , especially in writing complex and highly optimized queries across large volumes of data. Familiarity with Apache Airflow for job scheduling and orchestration. Experience mentoring junior team members and developing training documentation.

Location: Tijuana, MX

Posted Date: 5/12/2025