Data Engineer в BrainRocket Birkirkara

Data Engineer для построения и оптимизации масштабируемых пайплайнов данных с использованием Airflow, Snowflake и Kafka. Работа в офисе на Мальте с релокацией.

Задачи:

• Develop and implement data models to support business requirements, optimizing for performance and scalability
• Design, build, and maintain scalable data pipelines using Apache Airflow
• Implement and maintain Kafka-based streaming data pipelines for real-time data processing and integration with various systems
• Integration to third party databases and APIs
• Establish monitoring, alerting, and maintenance procedures to ensure the health and reliability of data pipelines
• Collaborate with cross-functional teams including data scientists, analysts, and stakeholders to understand data requirements

Требования:

• Proficiency in Python, SQL, and experience with data manipulation and transformation
• Data warehouse and data modelling techniques
• Experience in designing, building, and maintaining complex data pipelines using Airflow
• Proven track record in data engineering roles, with a focus on designing and implementing scalable data solutions using Snowflake or Redshift
• In-depth understanding and practical experience in implementing Kafka-based streaming architectures for real-time data processing

Условия:

• 24 days of vacation per year
• Private Health Insurance
• Daily Breakfasts and Friday lunches in the office
• Snacks in the Office
• Transport Allowance of up to 150 euro paid quarterly (public transport or taxi)
• Gym Subsidies for office building gym
• Tennis or Paddle Training sessions reimbursement, up to 100 EUR monthly
• Discount for Premium subscription for Cloudigo
• Discounts at partners of the company
• Annual salary reviews
• Birthday gifts
• Option for parking
• Regular office & team building events

Навыки:

• Python
• SQL
• Apache Airflow
• Snowflake
• Apache Kafka
• Redshift