Data Engineer
Tasks
- Apply data governance
- Build CI/CD pipelines
- Collaborate with developers designers and data scientists
- Design large-scale data pipelines
- Develop data ingestion and storage solutions
- Implement event-driven architectures
- Implement scalable APIs
- Manage big data infrastructure and cloud deployments
- Optimize system performance
- Use infrastructure as code
Perks/Benefits
Skills/Tech-stack
AWS CDK | Amazon QuickSight | Amazon Web Services | Ansible | Apache Spark | Azure | BigQuery | CI/CD | Cloud platform | DLT | Data Processing | Data Warehousing | Databricks | Delta Lake | Delta Sharing | DevOps | Distributed Computing | ETL | Go | Google Cloud | Google Cloud Platform | Infrastructure as Code | Java | Kafka | NoSQL | Power BI | Pulsar | Python | Real Time | Real-time Data | Real-time Data Processing | SQL | SQL Server | Scala | Snowflake | Tableau | Terraform | Unity Catalog | Web Services | “as-code”
Education
Roles
Related jobs
-
Integrador de Dados SR BRL 118K-119KAWS CloudWatch | AWS IAM | AWS Lambda | Amazon EC2 | Amazon RDSCloud optimization focus | Remote workSenior-level Full TimeRemote R8h ago
-
Apache Kafka | Apache Spark | BigQuery | Cloud Data | Cloud Data PlatformsFully remote work | Training and professional development initiativesSenior-level Full TimeRemote R9h ago
-
Associate Engineer, Data (FS) USD 119K-165KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure SQLLong-term work from home | Night shift schedule | Remote workMid-level Full TimeRemote R9h ago
-
Ingénieur / ingénieure Data – IA Générative EUR 60K-70KAWS | AWS Bedrock | Azure | CI/CD | Copilot StudioHealth insurance | Paid time off | Telework | Training opportunitiesSenior-level Full TimeÉchirolles, Auvergne-Rhône-Alpes, France R13h ago
-
Apache Hadoop | Apache Hive | Apache Kafka | Apache Spark | Azure HDInsightCareer development opportunities | Cooptation bonus | Employee representative council | Health insurance | Meal vouchersSenior-level Full TimeNantes, Pays de la Loire, France R13h ago
-
Agentic AI | Azure Repos | CI/CD | Cron | DeepEvalHybrid workSenior-level Contract Full TimeGlasgow, Scotland, United Kingdom R13h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R14h ago
-
Senior Data Engineer - Paris - H/F EUR 45K-55KAirflow | Batch data | CI/CD | ClickHouse | Data CatalogMeal allowance | Profit sharing | Remote work | Restaurant voucherSenior-level Full TimeParis, IDF, France R14h ago
-
Applied AI Software Engineer GBP 75K-90KAgile | Azure | Continuous Delivery | Data Observability | Data PrivacyAnnual leave | Critical illness protection | Cycle to work | Dental coverage | Electric vehicle schemeSenior-level Full TimeGlasgow, Lanarkshire, United Kingdom R15h ago
-
ADLS Gen2 | Apache Spark | Auto Loader | Azure | Azure DataSenior-level Full TimeAlphaville - Barueri, BR, 06.454-000 R21h ago
-
Data Engineer PHP 1200K-1440KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Hive | Apache SparkAnnual leave | Bereavement leave | Birthday leave | Flexible work arrangement | Hybrid work arrangementSenior-level Full TimeTaguig, Metro Manila, Philippines R23h ago
-
AWS CloudFormation | Airflow | Amazon Kinesis | Amazon Redshift | BigQueryFlexible schedule | Remote workMid-level Full TimePakistan - Remote R23h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R23h ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible schedule | Project based workSenior-level FreelanceUnited Kingdom - Remote R23h ago
-
Computer Science | MATLAB | NumPy | Pandas | PythonFlexible part-time hours | Project based workSenior-level FreelanceArgentina - Remote R23h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | Mathematics | NumPy | Number theoryFreelance opportunity | Part-time project-based workSenior-level FreelanceFlorida, United States - Remote R23h ago
-
C# | MATLAB | NumPy | Pandas | PythonProject based workSenior-level FreelanceSpain - Remote R23h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 100K-100KMATLAB | NumPy | Pandas | Python | RPart time freelance assignments | Project based workSenior-level FreelanceFrance - Remote R23h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | Combinatorics | Graph theory | MATLAB | NumPyFlexible hours | Part-time opportunities | Project based workSenior-level FreelanceTexas, United States - Remote R23h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R23h ago
-
Senior-level FreelancePortugal - Remote R23h ago
-
AI | API | Airtable | Automation | Google SheetsFlexible work hours | Remote workMid-level Full TimePakistan - Remote R23h ago
-
Computer Scientist - Fullstack INR 1800K-3500KAsynchronous programming | Bazel | CI/CD | Distributed Systems | ExpressMid-level Full TimeBangalore, India R23h ago
-
Technical Architect - Machine Learning USD 165K-200KAKS | AWS | Async Programming | Autogen | AzureSenior-level Full TimeUSA - Remote, United States R23h ago
-
Senior Machine Learning Engineer USD 150K-185KAWS | Artifact management | Auditability | Azure | Batch inferenceDental insurance | Disability insurance | EAP | Life insurance | Medical insuranceSenior-level Full TimeCHICAGO, IL, USA R23h ago