Data Engineer / データエンジニア
Tasks
- Automate data infrastructure with infrastructure as code
- Build data integration platforms
- Build data lakehouse and data catalog platforms
- Collaborate with product analytics risk security and compliance teams
- Design data ingestion pipelines
- Develop CI CD pipelines and shared data engineering frameworks
- Develop data processing workflows
- Implement data governance capabilities
- Monitor and operate data platforms using observability practices
- Operate data platforms for security privacy and regulatory compliance
- Optimize pipelines using CDC streaming and batch
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS DMS | Airflow | Apache Spark | CI/CD | Change Data Capture | CloudWatch | Dagster | Data Capture | Databricks | Datadog | Delta Lake | GitHub | GitOps | Grafana | Kafka | Observability | Prefect | Prometheus | Python | SQL | SRE | Terraform | Unity Catalog
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R11d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R24d ago
-
Senior Data Engineer - Finance USD 172K-203KARR | AWS | Apache Iceberg | Apache Spark | CRMDental insurance | Employee discounts | Flexible wellness time off | Health insurance | Hybrid workSenior-level Full TimeHybrid - San Francisco, California R11h ago
-
Sr. Data Engineer (HYBRID) USD 145K-160KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDBComplimentary club membership | Hybrid work schedule | Personal training | Pilates | Shop discountsSenior-level Full TimeNew York, NY, United States R11h ago
-
Data Engineer Pleno BRL 120K-120KAmazon Web Services | Apache Airflow | Configuration Management | DBT | DatahubRemote work | Work from BrazilMid-level Full TimeBrasil R12h ago
-
Data Engineer Sr BRL 119K-119KAmazon Web Services | Apache Airflow | DBT | Datahub | DockerRemote workSenior-level Full TimeBrasil R12h ago
-
AWS | Apache Kafka | Capacity Planning | Distributed Systems | Fault ToleranceSenior-level Full TimeTel Aviv/ Hybrid (Israel), Israel R15h ago
-
3NF | Apache Airflow | Azure | Azure Data | Azure Data FactoryAssurance santé | Participation et intéressement | Tickets restaurant | Transport public remboursé | TélétravailSenior-level Full TimeSaint-Priest, France R16h ago
-
Apache Iceberg | Apache Kafka | Cloud Cost Optimization | Cost Optimization | Data LakeHybrid work | On-call rotations | Technical documentation supportMid-level Full TimeMarcq-en-Barœul, Hauts-de-France, France R17h ago
-
AWS CloudTrail | AWS CloudWatch | AWS EMR | Apache Beam | Apache SparkCooptation bonuses | Disability support | Employee stock ownership | Equipment allowance | Great Place to Work certificationSenior-level Full TimeLyon, Auvergne-Rhône-Alpes, France R18h ago
-
AWS | Azure | Cloud Data | Cloud Data Platforms | Data LakeContinuous learning | Health work-life balance | Hybrid work model | International projects | Professional developmentSenior-level Contract Full TimeLATAM R18h ago
-
Senior AI Engineer (m/w/d) EUR 60K-68KAI Safety | AWS | Agentic Workflows | Artificial Intelligence | CI/CDAssistance with transportation | Development budget | Employer pension contributions | Ergonomic workplace | Events and partiesMid-level Full TimeRemote / Düsseldorf R19h ago
-
Applied Gen AI Engineer EUR 70K-80KAWS | Agile | Angular | Azure | CI/CDFlexible working hours | Health insurance | Meal vouchers | Paid time off | TeleworkSenior-level Full TimeLevallois-Perret, IDF, France R20h ago
-
Senior Software Engineer - Data Platform INR 3500K-4580KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkCompany holidays | Daily meals | Dental insurance | Family planning assistance | Fitness coachingSenior-level Full TimeBengaluru, Karnataka, India R20h ago
-
Mid-level Full TimeBangalore, Karnataka, India R20h ago
-
Alerting | Amazon Redshift | Anomaly Detection | CI/CD | DashboardsFully remote workSenior-level Full TimePoland R21h ago
-
Alerting | Amazon Redshift | Anomaly Detection | CI/CD | Cause analysisFully remote workSenior-level Full TimeAustria R21h ago
-
Alerting | Amazon Redshift | Aurora PostgreSQL | CI/CD | Cause analysisCollaboration with cross-functional teams | Exposure to modern data validation frameworks and observability technologies | Fully remote work | Opportunities for continuous improvement | Ownership over data reliability strategySenior-level Full TimeSweden R21h ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Aurora PostgreSQLFully remoteSenior-level Full TimeIsrael R21h ago
-
Alerting | Amazon Redshift | CI/CD | Cause analysis | DashboardsContinuous improvement | Cross-functional collaboration | Fully remote work | Opportunity for ownershipSenior-level Full TimeSaudi Arabia R21h ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Anomaly DetectionFully remoteSenior-level Full TimeBelgium R21h ago
-
Alerting | Amazon Redshift | Batch Processing | CI/CD | Cause analysisCollaboration with cross-functional teams | Fully remote work | Ownership over data reliability strategy | Remote opportunitySenior-level Full TimeUnited Arab Emirates R21h ago
-
Alerting | Amazon Redshift | Batch Processing | CI/CD | Cause analysisCross-functional collaboration | Fully remote work | Opportunity for continuous improvement | Ownership of data reliability strategySenior-level Full TimeTurkey R21h ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Aurora PostgreSQLCross-functional collaboration | Fully remote work | Ownership over data reliability strategySenior-level Full TimeAustralia R21h ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Anomaly DetectionContinuous improvement opportunities | Cross-functional collaboration | Fully remote work | Ownership over data reliability strategySenior-level Full TimeSouth Africa R21h ago