Detalhes da oferta
DescriptionThis project aims to build, maintain, and optimize a data ecosystem using Azure Databricks, integrating it with other Azure services. Deliverables include efficient data pipelines, robust data models, and support for advanced analytics in collaboration with international and multidisciplinary teams.
________________________________________
Responsibilities
• Develop and manage data pipelines using Databricks Notebooks and Spark SQL.
• Integrate Azure Databricks with services such as Azure Data Lake, SQL Data Warehouse, and Cosmos DB.
• Ensure optimal performance of ETL (Extraction, Transformation, and Loading) processes.
• Collaborate with data architects to implement efficient models and schemas.
• Monitor and improve data quality, efficiency, and reliability.
• Document pipeline architecture, development processes, and data governance.
• Collaborate with data scientists and analysts to meet strategic demands.
• Stay updated on trends and innovations in cloud computing, big data, and Azure Databricks.
________________________________________
Technical Skills Required
• Proven experience with Azure Databricks and related services.
• Strong programming skills in Python, Scala, or Java.
• Hands-on knowledge of Apache Spark.
• Proficiency in SQL, data modeling, and data warehousing concepts.
• Familiarity with DevOps practices and CI/CD pipelines.
________________________________________
Desirable Skills
• Experience with machine learning frameworks and libraries.
• Knowledge of additional big data tools and platforms.
• Familiarity with data visualization tools and techniques.
________________________________________
Mandatory Requirements
• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or equivalent experience.
• Proven expertise in data engineering projects involving Azure.
• Strong analytical and problem-solving skills.
• Fluency in English and Portuguese, with excellent teamwork abilities.
________________________________________
Nice to Have
• Practical experience in SaaS projects with Azure integrations.
• Certifications in Azure Data Engineer or related areas.
• Participation in projects using agile methodologies, such as Scrum.
________________________________________
Work Location : Lisbon
60% Remote and 40% Presential
Years of experience required: 5 years
| Distrito | Lisboa | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Habilitações mínimas | Curso Superior | ||||||||
| Experiência mínima | 5-10 anos | ||||||||
| Sector de actividade | TI, Telecomunicações e Comunicação | ||||||||
| Tipo de contrato | Full-time | ||||||||
| Tipo de oferta | Emprego | ||||||||
| Contactos |
Alium Consultancy Ltd
1 Canada Square, London, E14 5aa England E14 5AA-E14 5AA London United Kingdom
|