Talent.com
Data Engineer
Data Engineerleadtech • GR
Data Engineer

Data Engineer

leadtech • GR
9 ημέρες πριν
Τύπος θέσης
  • Quick Apply
Περιγραφή θέσης

We are looking for a Senior Data Engineer to design, develop, and optimize our data infrastructure on Google Cloud Platform (GCP) . You will architect scalable pipelines using Databricks, BigQuery, Google Cloud Storage, Apache Airflow, dbt, Dataflow, and Pub / Sub, ensuring high availability and performance across our ETL / ELT processes. You will leverage great expectations to enforce data quality standards. The role also involves building our Data Mart (Data Mach) environment, containerizing services with Docker and Kubernetes (K8s), and implementing CI / CD best practices.

A successful candidate has extensive knowledge of cloud-native data solutions, strong proficiency with ETL / ELT frameworks (including dbt), and a passion for building robust, cost-effective pipelines.

Key Responsibilities

Data Architecture & Strategy

  • Define and implement the overall data architecture on GCP, including data warehousing in BigQuery, data lake patterns in Google Cloud Storage, and Data Mart (Data Mach) solutions.
  • Integrate Terraform for Infrastructure as Code to provision and manage cloud resources efficiently.
  • Establish both batch and real-time data processing frameworks to ensure reliability, scalability, and cost efficiency.

Pipeline Development & Orchestration

  • Design, build, and optimize ETL / ELT pipelines using Apache Airflow for workflow orchestration.
  • Implement dbt (Data Build Tool) transformations to maintain version-controlled data models in BigQuery, ensuring consistency and reliability across the data pipeline.
  • Use Google Dataflow (based on Apache Beam) and Pub / Sub for large-scale streaming / batch data processing and ingestion.
  • Automate job scheduling and data transformations to deliver timely insights for analytics, machine learning, and reporting.
  • Event-Driven & Microservices Architecture

  • Implement event-driven or asynchronous data workflows between microservices.
  • Employ Docker and Kubernetes (K8s) for containerization and orchestration, enabling flexible and efficient microservices-based data workflows.
  • Implement CI / CD pipelines for streamlined development, testing, and deployment of data engineering components.
  • Data Quality, Governance & Security

  • Enforce data quality standards using Great Expectations or similar frameworks, defining and validating expectations for critical datasets.
  • Define and uphold metadata management, data lineage, and auditing standards to ensure trustworthy datasets.
  • Implement security best practices, including encryption at rest and in transit, Identity and Access Management (IAM), and compliance with GDPR or CCPA where applicable.
  • BI & Analytics Enablement

  • Integrate with Looker (or similar BI tools) to provide data consumers with intuitive dashboards and real-time insights.
  • Collaborate with Data Science, Analytics, and Product teams to ensure the data infrastructure supports advanced analytics, including machine learning initiatives.
  • Maintain Data Mart (Data Mach) environments that cater to specific business domains, optimizing access and performance for key stakeholders.
  • Requirements

  • 3+ years of professional experience in data engineering, with at least 1 year in mobile data .
  • Proven track record building and maintaining BigQuery environments and Google Cloud Storagebased data lakes.
  • Deep knowledge of Apache Airflow for scheduling / orchestration and ETL / ELT design .
  • Experience implementing dbt for data transformations, RabbitMQ for event-driven workflows, and Pub / Sub + Dataflow for streaming / batch data pipelines.
  • Familiarity with designing and implementing Data Mart (Data Mach) solutions, as well as using Terraform for IaC.
  • Strong coding capabilities in Python , Java , or Scala , plus scripting for automation.
  • Experience with Docker and Kubernetes (K8s) for containerizing data-related services.
  • Hands-on with CI / CD pipelines and DevOps tools (e.g., Terraform, Ansible, Jenkins, GitLab CI ) to manage infrastructure and deployments.
  • Proficiency in Great Expectations (or similar) to define and enforce data quality standards.
  • Expertise in designing systems for data lineage, metadata management, and compliance (GDPR, CCPA).
  • Strong understanding of OLTP ( Online Transaction Processing) and OLAP (Online Analytical Processing) systems.
  • Excellent communication skills for both technical and non-technical audiences.
  • High level of organization, self-motivation, and problem-solving aptitude.
  • Will be a plus

  • Machine Learning (ML) Integration : Familiarity with end-to-end ML workflows and model deployment on GCP (e.g., Vertex AI).
  • Advanced Observability : Experience with Prometheus, Grafana, Datadog, or New Relic for system health and performance monitoring.
  • Security & Compliance : Advanced knowledge of compliance frameworks such as HIPAA, SOC 2, or relevant regulations.
  • Real-Time Data Architectures : Additional proficiency in Kafka, Spark Streaming, or other streaming solutions.
  • Certifications : GCP-specific certifications (e.g., Google Professional Data Engineer) are highly desirable.
  • Benefits

    Why should you join us?

    Growth and career development

  • At Leadtech, we prioritize your growth. Enjoy a flexible career path with personalized internal training and an annual budget for external learning opportunities.
  • Work-Life balance

  • Benefit from a flexible schedule with flextime (7 - 9 : 30 a.m. start, 3 : 30 - 6 p.m. end) and the option of working full remote or from our Barcelona office. Enjoy free Friday afternoons with a 7-hour workday, plus a 35-hour workweek in July and August so you can savor summer!
  • Comprehensive benefits

  • Competitive salary, full-time permanent contract, and top-tier private health insurance (including dental and psychological services).
  • 25 days of vacation plus your birthday off, with flexible vacation options—no blackout days!
  • Unique Perks

  • If you wish to come, in our office in Barcelona you’ll find it coplete with free coffee, fresh fruit, snacks, a game room, and a rooftop terrace with stunning Mediterranean views.
  • Additional benefits include ticket restaurant and nursery vouchers, paid directly from your gross salary.
  • Join us in an environment where you’re free to innovate, learn, and grow alongside passionate professionals. At Leadtech, you’ll tackle exciting challenges and be part of a vibrant team dedicated to delivering exceptional user experiences

    Equal Employment Opportunity Employer :

    Leadtech is an Equal Employment Opportunity (EEO) Employer, which means we encourage applications from people with different backgrounds, interests, and personal circumstances. Our team welcomes applicants regardless of their race, gender, age, religion, nationality, sexual orientation, and / or disabilities. All we need is your high energy, skills, and willingness to be a part of a great project!

    Location

    You'll have the flexibility to choose whether you'd like to come to the office every day, from time to time, or work fully remote. We want you to find the best combination for you.

    If you prefer to be surrounded with amazing people, our exceptional office is in Barcelona’s Blue Building, located right on the city's seafront. Besides our stunning views, you’ll enjoy our office perks such as free fruit, snacks, and coffee and you’ll also be able to take part in our Mario Kart and table tennis competitions.

    The personal data you provide will be processed in order to manage your candidacy for the corporate selection processes that fit your profile. If you wish, you can exercise your rights of access, rectification or cancellation by writing to our address (Avenida Litoral, 12-14, 5ta planta. Barcelona. 08005) or to the email address protecciondedatos@LeadTech.com, attaching to your request a document that can validate your identity.

    Δημιουργήστε μια ειδοποίηση για αυτή την αναζήτηση

    Data Engineer • GR

    Παρόμοιες θέσεις εργασίας
    MLOps Engineer

    MLOps Engineer

    TRG TECH RESEARCH GROUP Limited • GR
    Quick Apply
    At TRG we work in a global environment where every diverse personality and culture is included.We look for talented people worldwide who have passion for what they do and work together, shoulder to...Δείτε περισσότερα
    Τελευταία ενημέρωση: 11 πριν από ημέρες
    Visual Prompt Engineer

    Visual Prompt Engineer

    Soar With Us • GR
    Quick Apply
    Role : AI Videographer / Visual Prompt Engineer (Performance Creative).Function : | AI Video Production | Performance Creative | Automation & Scale. Responsibility : Own AI-powered video production...Δείτε περισσότερα
    Τελευταία ενημέρωση: 4 πριν από ημέρες
    DevSecOps Engineer

    DevSecOps Engineer

    GoMining • GR
    Quick Apply
    A DevSecOps Engineer is responsible for integrating security practices into the entire software development lifecycle, ensuring that applications, infrastructure, and operations are secure by desig...Δείτε περισσότερα
    Τελευταία ενημέρωση: πριν από 30+ ημέρες
    Freelance Agent Evaluation Engineer

    Freelance Agent Evaluation Engineer

    Mindrift • GR
    Quick Apply
    This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of En...Δείτε περισσότερα
    Τελευταία ενημέρωση: 2 πριν από ημέρες
    AI / ML Engineer (LLMs & Applied AI)

    AI / ML Engineer (LLMs & Applied AI)

    TRG TECH RESEARCH GROUP Limited • GR
    Quick Apply
    At TRG we work in a global environment where every diverse personality and culture is included.We look for talented people worldwide who have passion for what they do and work together, shoulder to...Δείτε περισσότερα
    Τελευταία ενημέρωση: 8 πριν από ημέρες
    DevOps Engineer

    DevOps Engineer

    TRG TECH RESEARCH GROUP Limited • GR
    Quick Apply
    At TRG we work in a global environment where every diverse personality and culture is included.We look for talented people worldwide who have passion for what they do and work together, shoulder to...Δείτε περισσότερα
    Τελευταία ενημέρωση: πριν από 30+ ημέρες
    iOS Software Engineer

    iOS Software Engineer

    Moro Tech • GR
    Quick Apply
    Ready to Make an Impact? Join MORO TECH!.MORO TECH is a tech house with a global team on a mission to empower businesses to succeed through business transformation solutions, data-driven strategies...Δείτε περισσότερα
    Τελευταία ενημέρωση: 8 πριν από ημέρες
    Freelance Machine Learning Engineer (Python)

    Freelance Machine Learning Engineer (Python)

    Mindrift • GR
    Quick Apply
    This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of En...Δείτε περισσότερα
    Τελευταία ενημέρωση: πριν από 30+ ημέρες
    Data Specialist (Remote / Hybrid)

    Data Specialist (Remote / Hybrid)

    Alex Staff Agency • GR
    Quick Apply
    About the company and the project : .An international company, a leader in developing large-scale energy storage and grid-stability technologies, is in search of a highly skilled and experienced ...Δείτε περισσότερα
    Τελευταία ενημέρωση: 23 πριν από ημέρες
    Android Software Engineer

    Android Software Engineer

    Moro Tech • GR
    Quick Apply
    Ready to Make an Impact? Join MORO TECH!.MORO TECH is a tech house with a global team on a mission to empower businesses to succeed through business transformation solutions, data-driven strategies...Δείτε περισσότερα
    Τελευταία ενημέρωση: 8 πριν από ημέρες
    AI Agent Engineer (Python & Azure)

    AI Agent Engineer (Python & Azure)

    CROWDCONSULTANTS • Greece, GR
    Quick Apply
    This job operates on a hybrid model, requiring you to be based and work from within Bulgaria.AI-powered agents and workflows. Python, LLMs, and frameworks such as.Azure ML, Cognitive Services, Azure...Δείτε περισσότερα
    Τελευταία ενημέρωση: πριν από 30+ ημέρες
    Research & Software Engineer

    Research & Software Engineer

    TRG TECH RESEARCH GROUP Limited • GR
    Quick Apply
    At TRG we work in a global environment where every diverse personality and culture is included.We look for talented people worldwide who have passion for what they do and work together, shoulder to...Δείτε περισσότερα
    Τελευταία ενημέρωση: πριν από 30+ ημέρες
    Electrical Engineer with Python Experience - Freelance AI Trainer

    Electrical Engineer with Python Experience - Freelance AI Trainer

    Mindrift • GR
    Quick Apply
    This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of En...Δείτε περισσότερα
    Τελευταία ενημέρωση: πριν από 30+ ημέρες
    QA Engineer

    QA Engineer

    GoMining • GR
    Quick Apply
    We are looking for a proactive QA engineer with strong mobile and API testing experience who is confident with Allure TestOps, Postman, DevTools, SQL, and Git. You will create clear test plans, ensu...Δείτε περισσότερα
    Τελευταία ενημέρωση: πριν από 30+ ημέρες
    Senior Backend Engineer - Rust (Remote EU)

    Senior Backend Engineer - Rust (Remote EU)

    RetinAI Medical • GR
    Quick Apply
    Ikerian AG (formerly RetinAI Medical).Our mission is to enable the right decisions sooner in healthcare, through transformative AI & data management solutions for disease screening and monitori...Δείτε περισσότερα
    Τελευταία ενημέρωση: πριν από 30+ ημέρες
    Web Consultant (Requirements Engineer / Tester) fluent in English

    Web Consultant (Requirements Engineer / Tester) fluent in English

    EUROPEAN DYNAMICS • GR
    Quick Apply
    Are you fluent in English with expertise in web consulting? Join us in Athens or work remotely, and become part of our team. You'll have the opportunity to offer your services and collaborate closel...Δείτε περισσότερα
    Τελευταία ενημέρωση: πριν από 30+ ημέρες
    MCP & Tools Python Developer - Agent Evaluation Infrastructure

    MCP & Tools Python Developer - Agent Evaluation Infrastructure

    Mindrift • GR
    Quick Apply
    This opportunity is only for candidates currently residing in the specified country.Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of En...Δείτε περισσότερα
    Τελευταία ενημέρωση: πριν από 30+ ημέρες
    Junior QA Engineer

    Junior QA Engineer

    EUROPEAN DYNAMICS • GR
    Quick Apply
    Passionate about software quality? Are you a.We are currently seeking a talented individual to join our team.You have the option to work from our Thessaloniki or Athens office, or remotely.Analyze ...Δείτε περισσότερα
    Τελευταία ενημέρωση: πριν από 30+ ημέρες