Job Description

We are looking for a highly experienced Senior Big Data Engineer to join our team in Berlin. In this full-time role, you will design, implement, and manage scalable big data solutions, enabling advanced analytics and data-driven decisions. This position is perfect for a seasoned professional passionate about handling large-scale data challenges and leading data engineering projects.

Key Responsibilities

• Design and build robust big data pipelines and infrastructure to handle massive datasets.
• Develop and maintain ETL processes for efficient data ingestion, transformation, and storage.
• Optimize data systems for scalability, reliability, and performance.
• Collaborate with data scientists and analysts to ensure data availability and usability.
• Implement best practices for data security and governance.
• Monitor and troubleshoot big data systems to ensure uptime and data accuracy.
• Mentor junior engineers and provide technical leadership on big data projects.

Tech Skills Needed

• Big Data Tools: Expertise in Hadoop, Spark, Kafka, or similar frameworks.
• Cloud Platforms: Proficiency in AWS, GCP, or Azure big data services.
• Programming: Strong skills in Python, Scala, or Java for data processing.
• Database Systems: Experience with NoSQL databases (Cassandra, MongoDB) and traditional SQL databases.
• Data Modeling: Understanding of data lake and data warehouse design patterns.
• Orchestration Tools: Familiarity with Apache Airflow, Luigi, or similar workflow automation tools.
• Containerization: Knowledge of Docker and Kubernetes for deploying scalable data systems.
• Version Control: Proficiency with Git for collaborative development.

Requirements

• 7+ years of professional experience in big data engineering or a related field.
• A degree in Computer Science, Data Engineering, or a related discipline.
• Proven track record of handling large-scale data systems and infrastructure.
• Strong problem-solving and debugging skills.
• Excellent communication and collaboration abilities.
• Proficiency in English; knowledge of German is a plus.

Preferred Qualifications

• Experience in real-time data streaming and processing.
• Knowledge of advanced analytics and machine learning integration.
• Certification in big data tools or cloud platforms.

What We Offer

• Competitive salary (€6,000 – €8,500 per month, based on experience).
• Flexible working hours and remote work options.
• A chance to work on cutting-edge technologies and innovative projects.
• A supportive and diverse team environment.
• Comprehensive benefits package, including health insurance, paid leave, and professional development programs.