Databricks Engineer (anshv)
PROJECT OVERVIEW
Our client is a leading commercial real estate advisory and services provider, supporting large institutional investors, global corporations, and other owners and occupiers. Their mission is to make leasing, buying, and selling properties across the retail, office, multifamily, industrial, student housing, and hospitality sectors easier and more efficient.
The organization brings together deep market expertise and technology to guide clients through every stage of the real estate lifecycle, creating better outcomes for all stakeholders. Recently, the group acquired a premier UK-based chartered surveying and property consultancy, which is now undergoing transformation and alignment with the broader global organization.
As part of this transformation, data is becoming a core strategic asset, with a strong focus on building a modern, scalable data platform powered by Microsoft Azure and Databricks.
We are seeking a skilled Data Engineer to play a key role in delivering this vision. You will work with diverse datasets—internal, third-party, and public—integrating them into a global data lake and building advanced data pipelines, with Databricks as a central component of the data processing and analytics ecosystem.
IN THIS ROLE, YOU WILL
Design, develop, and maintain scalable data pipelines using Microsoft Azure and Databricks (Spark).
Build and optimize ETL/ELT workflows in Databricks, leveraging PySpark and SQL for large-scale data processing.
Integrate and land various data sources—including internal, licensed third-party, and public datasets—into the global data lake.
Develop and maintain Delta Lake architectures to ensure reliable, high-performance data storage and processing.
Collaborate with business analysts, data scientists, and engineering teams to define data requirements and deliver high-quality data products.
Use Python and SQL to automate data ingestion, transformation, and validation processes.
Monitor, troubleshoot, and optimize Databricks jobs and clusters for performance, scalability, and cost efficiency.
Implement data quality, governance, and security best practices across the platform.
Participate in documentation, code reviews, and knowledge sharing across a global team.
IF YOU HAVE
5+ years of professional experience in data engineering or similar roles.
Strong hands-on experience with Databricks, including Apache Spark (PySpark/SQL) and Delta Lake.
Proven experience building scalable data pipelines in Azure (ADF, Synapse, Blob Storage, Azure SQL, Functions, etc.).
Proficiency in Python and SQL for data engineering and transformation tasks.
Experience working with large-scale, distributed data processing systems.
Solid understanding of data modelling, data warehousing, and modern data lake architectures.
Experience integrating multiple data sources, including structured and unstructured data.
Strong problem-solving, documentation, and collaboration skills.
AS AN OPINOV8R, YOU WILL HAVE
Digital-First Approach: Great talent knows no borders! You can work from wherever you are — we hire and collaborate with professionals worldwide.
Remote Work Model: Balance your professional and personal life with our flexible working conditions, empowering you to deliver your best from anywhere.
Exciting Projects: Dive into impactful projects across industries that challenge and spark creativity.
Boost Your Expertise: Grow your career with continuous learning, development opportunities, and hands-on experience.
Join the Best Team Ever: Collaborate with our diverse and cross-cultural team of passionate technologists and creative thinkers.
HOW’S THE HIRING PROCESS GOING
We strive to make our hiring process smooth and transparent to find the perfect match for both sides. Steps may differ depending on the role, but here’s what to expect:
Initial Interview: If your background fits the role, we’ll invite you for an interview with a Talent Acquisition Specialist.
Technical Interview: Depending on the position, you may complete a technical assessment or test task.
Client Interview
Final Decision: After all steps, we’ll get back to you with the result and next steps.
- Department
- Data Engineering
- Locations
- Portugal
- Remote status
- Fully Remote
- Employment type
- Full-time