Senior Data Engineer

Hello,

I hope you are doing good.

Position – Senior Data Engineer

Location – Stockholm, Sweden

Experience - 8+ Years

Language - English

Duration - 6 months B2B Contract, It's extendable.

Job Description

Cloud Data Engineering Design, build, and optimize data pipelines on GCP using BigQuery, Dataflow, Dataproc,cloud funtions, cloud run and Cloud Storage.Implement ETL workflows for batch and streaming data ingestion.Develop scalable data lake and warehouse architectures following best practices.Optimize query performance through partitioning, clustering, compression, and schema design.(Big query, Bigtable , spanner and fire store)Terraform , DBT knowledge is required with hand on experienceData Processing ModelingBuild realtime streaming pipelines using PubSub Dataflow (Apache Beam).Create dimensional models, starsnowflake schemas, and semantic layers. Write efficient SQL and Python for transformations and automation.Looker knowledge (very important)Orchestration AutomationAutomate workflows using Cloud Composer (Airflow).Implement CI/CD pipelines for data deployments using Cloud Build and Terraform integrated in GitHub Manage versioning, testing, and environment configuration.Security GovernanceApply IAM role-based access, service accounts, VPCSC, and encryption policies.Implement data quality checks and governance using Dataplex and validation frameworks.Ensure compliance with GDPR and internal data security standards.(Encryption and decryption concepts and use of CMEK)Operations MonitoringSet up monitoring dashboards and alerts using Cloud Monitoring Logging.Optimize resource usage to ensure costefficient data processing.Troubleshoot pipeline failures, performance bottlenecks, and data integrity issues.Collaboration Stakeholder InteractionPartner with data analysts, ML teams, and product owners to define data needs.Translate business requirements into scalable cloud architecture.Document data flows, standards, lineage, and best practices for crossteam adoption.