Data Engineer
- Hybrid
- Porto, Porto, Portugal
- Lisboa, Lisboa, Portugal
+1 more
Job description
📢 Our Mission
Ivy Partners is a Swiss consulting firm that assists companies in overcoming their strategic, technological, and organizational challenges.
We are committed to providing our employees with a career that promotes both their personal and professional development. We support their skill enhancement and offer them real opportunities for progression.
👩💻🧑💻 As a Data Engineer at Ivy Partners, you will be tasked with:
- Designing, developing, and maintaining end-to-end data ingestion pipelines that support batch, near real-time, streaming, and event-driven patterns.
- Building and maintaining connectors for various sources including APIs (REST), relational and NoSQL databases, filesystems (Windows, Linux, SharePoint), SaaS platforms, and more.
- Implementing data quality checks, validation rules, and data contracts as outlined by the client and Data Office.
- Applying robust software engineering practices in Python, including modular design, packaging, unit testing, and documentation.
- Implementing CI/CD pipelines and automation using Docker and GitHub Actions with disciplined Git workflows and code reviews.
- Performing integration testing in development environments and supporting production releases in collaboration with internal teams.
- Implementing monitoring, alerting, and dashboards to ensure observability and efficient troubleshooting.
- Taking operational ownership of delivered pipelines, including incident handling and hot fixes when required.
- Contributing to cost optimization and efficient resource usage with a FinOps-aware mindset.
Job requirements
🏅 About You
You are our ideal candidate if:
- You have over 5 years of experience as a Data Engineer with considerable exposure to data ingestion in production environments.
- You possess advanced Python skills demonstrated by your experience in building production-grade data pipelines.
- You have solid experience with PySpark and Pandas.
- You are experienced in using AWS and Databricks platforms.
- You have a strong track record with CI/CD and automation using Docker and GitHub Actions.
- You are skilled in integrating with APIs, including all aspects from authentication to robust error handling.
- You have implemented observability practices including logging, metrics, alerting, and run management.
- You maintain a strong Git discipline, featuring daily commits, feature branches, pull requests, and code reviews.
- You are fluent in English, both written and spoken.
- You hold a strong sense of ownership and autonomy, with the ability to thrive in high-expectation, delivery-focused environments.
🤝 Why Join Ivy Partners?
We commit to:
- Caring for our employees | We provide a supportive environment where everyone is valued, along with training and career opportunities both in Switzerland and internationally.
- Creating a climate of trust | Working with us means building a relationship based on transparency, professionalism, and commitment.
- Encouraging innovation | We blend technology and creativity to achieve impactful digital transformations.
- Taking responsibility | We are dedicated to collective action and strive to have a positive impact.
or
- Porto, Porto, Portugal
- Lisboa, Lisboa, Portugal
All done!
Your application has been successfully submitted!
