Senior Data Engineer
Tasks
- Build ingestion pipelines
- Deploy ETL resources with CloudFormation
- Design ETL pipelines
- Develop semantic layer
- Implement automated ETL reporting
- Implement data quality checks
- Integrate ETL common library into jobs
- Maintain dataset documentation suite
- Operationalize derived data products
- Parse and ingest XML filings
- Participate in agile delivery with Jira and GitHub
- Perform security scans
- Prevent duplicate data loads
- Store curated data in Apache Iceberg
- Write Python code with tests
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon Athena | Amazon EMR | Amazon MWAA | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Apache Hive | Apache Iceberg | Apache Spark | Athena | Avro | CI/CD | CloudFormation | Data Lake | Data Quality | Deequ | ETL | EventBridge | GitHub | ORC | Oracle | Parquet | PostgreSQL | PySpark | Python | Step Functions | Trino | XML
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Featured Feat. Software Engineer USD 40K-150K.NET | APIs | AWS | Angular | AzureContractor hours flexibility | Remote workMid-level ContractRemote R12d ago
-
Featured Feat. Senior Software Engineer USD 80K-170KAlgorithms | C++ | Data Structures | Go | JavaContractor flexibility | Remote workSenior-level ContractRemote R12d ago
-
AI | Autonomous Systems | C++ | Computer Vision | DockerContinuous learning | Fully remote | Knowledge sharing | Opportunity to contribute to open-source projectsSenior-level Full TimeBrazil R8h ago
-
AWS | Azure | CI/CD | Databricks | Databricks SQL100 percent remote within Latin America | Long term project extension potential | Professional growthSenior-level Full TimeBrazil R8h ago
-
AWS | Bash | CI/CD | Databricks | DatadogContinuous learning culture | Healthcare coverage | International collaboration opportunities | Paid parental leave | Relocation assistanceSenior-level Full TimeRomania R9h ago
-
AWS | Azure | Bash | Databricks | DatadogFully remote | Healthcare coverage | International collaboration opportunities | Paid parental leave | Relocation assistanceSenior-level Full TimeItaly R9h ago
-
AWS | Azure | Bash | CI/CD | Data pipelineFully remote work | Healthcare coverage | Inclusive culture | International collaboration opportunities | Paid parental leaveSenior-level Full TimePortugal R9h ago
-
AWS | Bash | Cloud platform | Databricks | DatadogFully remote work | Healthcare coverage | Inclusive culture | International collaboration | Paid parental leaveSenior-level Full TimeNetherlands R9h ago
-
AWS | Azure | Bash | Databricks | DatadogContinuous learning culture | Fully remote work | Healthcare coverage | International collaboration | Paid parental leaveSenior-level Full TimeIreland R9h ago
-
AWS | Alerting | Azure | Bash | CI/CDContinuous learning | Fully remote | Healthcare coverage | Inclusive culture | International collaborationSenior-level Full TimeSwitzerland R9h ago
-
AWS | Azure | Databricks | Datadog | FastAPIContinuous learning culture | Healthcare coverage | International collaboration | Paid parental leave | Relocation assistanceSenior-level Full TimeFrance R9h ago
-
AWS | Bash | CI/CD | Databricks | DatadogContinuous learning culture | Fully remote | Healthcare coverage | International collaboration opportunities | Paid parental leaveSenior-level Full TimeSpain R9h ago
-
AWS | Azure | Bash | CI/CD | Data pipelineContinuous learning | Fully remote work | Healthcare coverage | Inclusive culture | International collaboration opportunitiesSenior-level Full TimeGermany R10h ago
-
Principal Data Engineer USD 160K-170KAWS | Amazon Redshift | Apache Airflow | BigQuery | Cloud platform401k match | Dental insurance | Health insurance | Paid time off | Remote workSenior-level Full TimeRemote (United States) R13h ago
-
Data Governance Engineer INR 980K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsAgile career development | Comprehensive benefits dependent on location | Inclusive workplace | Remote work flexibilityMid-level Full TimeIN - Hyderabad, India R14h ago
-
AI Solutions Engineer CAD 173K-233KAPIs | Authentication | CI/CD | Circuit Breakers | ContainersDental insurance | Employee stock purchase plan | Flexible spending accounts | Health insurance coverage | Paid time offMid-level Full TimeRemote Canada R14h ago
-
AI Solutions Engineer USD 195K-280KAPIs | Authentication | CI/CD | Containerization | DBTDental insurance | ESPP | Flexible spending accounts | Health insurance | Remote work flexibilityMid-level Full TimeRemote US R14h ago
-
Senior Data Engineer USD 185K-200KAWS Glue | Amazon Athena | Amazon Bedrock | Amazon OpenSearch | Amazon S3401k company match | Comprehensive health coverage | Equity purchase option | Flexible work schedule | Generous time offSenior-level Full TimeLos Angeles Office R15h ago
-
Lead Machine Learning Engineer, Inference & Performance USD 184K-270KAttention Mechanism | Batching | CUDA | Data Engineering | FlashAttention401k employer match | Bereavement leave | Comprehensive health insurance | Employee referral bonuses | Paid HolidaysSenior-level Full TimeRemote R16h ago
-
Health IT Data Engineer USD 125K-135KAzure | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsRemote work within continental United States | US federal security suitability requiredSenior-level Full TimeContinental United States R17h ago
-
AI/ML Platform Software Developer USD 160K-220KAPIs | Agentic AI | Backend Development | Cloud Native | Continuous MonitoringSenior-level Full TimeRemote (United States) R17h ago
-
Android | C# | C++ | Csharp | ONNXMid-level Full TimeMountain View, CA, US; Redmond, WA, … R17h ago
-
Lead AI Engineer USD 198K-261KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningSenior-level Full TimeChicago, Illinois, USA R18h ago
-
Mid-level Full TimeRemote, Brazil R19h ago
-
QA Automation Engineer SR (QB - QASR - 20260701) USD 110K-149KAI Assisted Development | API mocking | Allure | Automated code review | Azure DevOpsSenior-level Contract Full TimeRemote R20h ago