Senior Data Engineer
Tasks
- Build ingestion pipelines
- Deploy ETL resources with CloudFormation
- Design ETL pipelines
- Develop semantic layer
- Implement automated ETL reporting
- Implement data quality checks
- Integrate ETL common library into jobs
- Maintain dataset documentation suite
- Operationalize derived data products
- Parse and ingest XML filings
- Participate in agile delivery with Jira and GitHub
- Perform security scans
- Prevent duplicate data loads
- Store curated data in Apache Iceberg
- Write Python code with tests
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Lambda | Amazon Athena | Amazon EMR | Amazon MWAA | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Apache Hive | Apache Iceberg | Apache Spark | Athena | Avro | CI/CD | CloudFormation | Data Lake | Data Quality | Deequ | ETL | EventBridge | GitHub | ORC | Oracle | Parquet | PostgreSQL | PySpark | Python | Step Functions | Trino | XML
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Featured Feat. Software Engineer USD 40K-150K.NET | APIs | AWS | Angular | AzureContractor hours flexibility | Remote workMid-level ContractRemote R12d ago
-
Featured Feat. Senior Software Engineer USD 80K-170KAlgorithms | C++ | Data Structures | Go | JavaContractor flexibility | Remote workSenior-level ContractRemote R12d ago
-
AI | Autonomous Systems | C++ | Computer Vision | DockerContinuous learning | Fully remote | Knowledge sharing | Opportunity to contribute to open-source projectsSenior-level Full TimeBrazil R6h ago
-
AWS | Azure | CI/CD | Databricks | Databricks SQL100 percent remote within Latin America | Long term project extension potential | Professional growthSenior-level Full TimeBrazil R6h ago
-
AWS | Bash | CI/CD | Databricks | DatadogContinuous learning culture | Healthcare coverage | International collaboration opportunities | Paid parental leave | Relocation assistanceSenior-level Full TimeRomania R7h ago
-
AWS | Azure | Bash | Databricks | DatadogFully remote | Healthcare coverage | International collaboration opportunities | Paid parental leave | Relocation assistanceSenior-level Full TimeItaly R7h ago
-
AWS | Azure | Bash | CI/CD | Data pipelineFully remote work | Healthcare coverage | Inclusive culture | International collaboration opportunities | Paid parental leaveSenior-level Full TimePortugal R7h ago
-
AWS | Bash | Cloud platform | Databricks | DatadogFully remote work | Healthcare coverage | Inclusive culture | International collaboration | Paid parental leaveSenior-level Full TimeNetherlands R7h ago
-
AWS | Azure | Bash | Databricks | DatadogContinuous learning culture | Fully remote work | Healthcare coverage | International collaboration | Paid parental leaveSenior-level Full TimeIreland R7h ago
-
AWS | Alerting | Azure | Bash | CI/CDContinuous learning | Fully remote | Healthcare coverage | Inclusive culture | International collaborationSenior-level Full TimeSwitzerland R7h ago
-
AWS | Azure | Databricks | Datadog | FastAPIContinuous learning culture | Healthcare coverage | International collaboration | Paid parental leave | Relocation assistanceSenior-level Full TimeFrance R7h ago
-
AWS | Bash | CI/CD | Databricks | DatadogContinuous learning culture | Fully remote | Healthcare coverage | International collaboration opportunities | Paid parental leaveSenior-level Full TimeSpain R7h ago
-
AWS | Azure | Bash | CI/CD | Data pipelineContinuous learning | Fully remote work | Healthcare coverage | Inclusive culture | International collaboration opportunitiesSenior-level Full TimeGermany R7h ago
-
AI Solutions Engineer CAD 173K-233KAPIs | Authentication | CI/CD | Circuit Breakers | ContainersDental insurance | Employee stock purchase plan | Flexible spending accounts | Health insurance coverage | Paid time offMid-level Full TimeRemote Canada R12h ago
-
AI Solutions Engineer USD 195K-280KAPIs | Authentication | CI/CD | Containerization | DBTDental insurance | ESPP | Flexible spending accounts | Health insurance | Remote work flexibilityMid-level Full TimeRemote US R12h ago
-
Senior Data Engineer USD 185K-200KAWS Glue | Amazon Athena | Amazon Bedrock | Amazon OpenSearch | Amazon S3401k company match | Comprehensive health coverage | Equity purchase option | Flexible work schedule | Generous time offSenior-level Full TimeLos Angeles Office R13h ago
-
Lead Machine Learning Engineer, Inference & Performance USD 184K-270KAttention Mechanism | Batching | CUDA | Data Engineering | FlashAttention401k employer match | Bereavement leave | Comprehensive health insurance | Employee referral bonuses | Paid HolidaysSenior-level Full TimeRemote R14h ago
-
Health IT Data Engineer USD 125K-135KAzure | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsRemote work within continental United States | US federal security suitability requiredSenior-level Full TimeContinental United States R15h ago
-
Lead AI Engineer USD 198K-261KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningSenior-level Full TimeChicago, Illinois, USA R16h ago
-
Mid-level Full TimeRemote, Brazil R17h ago
-
QA Automation Engineer SR (QB - QASR - 20260701) USD 110K-149KAI Assisted Development | API mocking | Allure | Automated code review | Azure DevOpsSenior-level Contract Full TimeRemote R18h ago
-
Automated testing | CI/CD | Computer Vision | Continuous integration | DeepStreamRelocation bonus | Remote-friendly | Team onsite opportunities | Travel stipendMid-level Full TimeNY, SF or Remote R18h ago
-
Mid-level Full TimeRemote R19h ago
-
Lead Analytics Engineer CAD 160K-185KCDC | CI/CD | DBT | Data Governance | Data LineageAnnual professional development budget | Charitable donation match | Dental insurance | Flexible time off | Medical insuranceSenior-level Full TimeRemote - Ontario, Canada R19h ago
-
Lead Analytics Engineer CAD 160K-185KCDC | CI/CD | Cost Optimization | DBT | Data CatalogCharitable donation match | Dental insurance | Flexible time off | Medical insurance | Paid parental leaveSenior-level Full TimeRemote - Alberta, Canada R19h ago