Sr. Data Engineer
Tasks
- Build APIs data microservices and ETL pipelines
- Build and support data ingestion frameworks in Azure
- Create interfaces to public data sets
- Develop DevOps and Quality Assurance culture
- Document code framework standards and team processes
- Fine-tune large language models
- Implement retrieval-augmented generation frameworks
- Write Scala code and serverless functions
Perks/Benefits
- N/A
Skills/Tech-stack
API Design | Apache Spark | Azure | Batch Processing | Big Data | C# | Data microservices | Databricks | DevOps | ETL | Event Sourcing | Hive | Language Models | Large Language Models | Microservices | Quality Assurance | RAG | Retrieval-Augmented Generation | SQL | Scala | Serverless | Service Oriented | Service-Oriented Architecture | Streaming Data
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Engineering | Bachelor of Science in Computer Science | Bachelor of Science in Information Systems
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R17d ago
-
Data Engineer - AI, Hybrid USD 137K-200KDBT | Data Cleansing | Data Imputation | Data Modeling | Data Quality401k matching contribution | 401k plan | Disability coverage | Hybrid work model | Life insuranceSenior-level Full TimeUSA-RESEARCH TRIANGLE PARK, United States R9h ago
-
Airflow | Apache Spark | CI/CD | DBT | Data LakehouseFlexible working hours | Homeoffice | Inclusion-focused culture | Internal knowledge transfer | Team events and activitiesMid-level Full TimeBonn, Hybrid R1d ago
-
Lead AI Engineer BGN 90K-105KAWS | BERT | Chain-of-Thought | Docker | Few-Shot LearningAcademic teaching opportunities | Dental allowance | Flexible working hours | Health insurance | Knowledge sharing sessionsSenior-level Full TimeSofia City Province, Bulgaria - Remote R1d ago
-
Analytics Engineering Advocate - Europe GBP 65K-100KAI Coding Assistants | AI coding | Coding assistants | Command Line | DBTFlexible schedule | Remote workSenior-level Full TimeRemote R1d ago
-
Senior Data Engineer EUR 70K-90KAutomated testing | CI/CD | Claude Code | ClickHouse | Data ProcessingCareer development | Coaching | Flexible working hours | Learning time | Location Based Social BenefitsSenior-level Full TimeGermany /Spain / Romania (Remote) R1d ago
-
Data Scientist / Machine Learning Engineer USD 110K-133KAWS SageMaker | Agile | Apache Airflow | Azure Machine Learning | DBTEnglish communication | Remote workMid-level Full TimeBrazil / Colombia / Costa Rica … R1d ago
-
Data Engineer GBP 52K-70KAWS | Apache Flink | Apache Spark | Cloud platform | ElasticsearchHealth and wellness benefits | Opportunity for career growth | Remote work option | Work with cutting-edge technologyMid-level Full TimeLondon R1d ago
-
Analytics Engineer Data & AI Senior - F/H - CDI EUR 50K-64KAWS | Agile | Automated testing | Azure | Azure DevOpsSenior-level Full TimeParis, IDF, France R1d ago
-
AI Center | AI orchestration | Action Center | Agile | AuthenticationMid-level ContractNashville, United States R1d ago
-
Applied AI Engineer, Investments USD 134K-183KAPIs | Cloud Computing | Data Pipelines | Data Quality | Data ValidationEmployer 401k match | Family forming benefits funding | Hybrid work onsite at least 60 percent of the time | Paid time off | Relocation supportNone Full TimeRedwood City, CA (Hybrid) R2d ago
-
Generative AI Engineer USD 100K-150KBenchmarks | Dataset Construction | Direct Preference Optimization | Distributed Training | EvaluationCareer growth | Remote workMid-level Full TimeUnited States - Remote R2d ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Senior Machine Learning Engineer CAD 113K-153KA/B | A/B Testing | API Design | Azure Machine Learning | B testingRemote workSenior-level Full TimeVancouver, British Columbia, Canada R2d ago
-
Senior DataOps Engineer USD 150K-180K800-171 | AWS CloudFormation | AWS Glue | AWS GovCloud | AWS IAMRemote position | US government clearance requiredSenior-level Full TimeRemote - United States R2d ago
-
Senior Data Science Engineer I, Claims USD 170K-190KAWS | Apache Airflow | Automated testing | ClickHouse | Data Modeling401k matching | Disability and life insurance | Flexible working hours | Fully remote work | HSA & FSA optionsSenior-level Full TimeRemote R2d ago
-
Senior AI Engineer, Real-World Data USD 137K-175KAI orchestration | AWS | AWS Fargate | AWS Lambda | AWS S3401k benefits | Commuter benefits | Employee referral program | Fertility care benefits | Free testingSenior-level Full TimeUS Remote R2d ago
-
Senior AI Engineer USD 188K-258KAgentic Systems | Agile | Cloud Architecture | Code review | Configuration ManagementCell phone allowance | Comprehensive health coverage | Equity for every employee | Growth-focused environment | Home office setup allowanceSenior-level Full TimeRemote - US R2d ago
-
Amazon Redshift | Amazon SageMaker | Amazon Web Services | Azure Machine Learning | Azure SynapseDental insurance | Flexible spending account | Health insurance | Paid time off | Stock optionsEntry-level Full TimeUnited States - Remote R2d ago
-
Staff Data Engineer USD 237K-270KAmazon EMR | Amazon Redshift | Apache Airflow | Apache Flink | Apache SparkFamily planning support | Flexible time off | Lifestyle stipend | Mental health support | Paid parental leaveSenior-level Full TimeSan Francisco, CA R2d ago
-
Senior Performance Engineer, Data Products USD 172K-195KAPI | Benchmarking | ClickHouse | ClickHouse Cloud | Concurrency401k matching | Co hanging stipend | Company sponsored disability insurance | Company-sponsored life insurance | DCFSASenior-level Full TimeRemote R2d ago
-
Mid-level Full TimeRemote, United States R2d ago
-
Senior DataOps Engineer ( Remote US) USD 113K-163KAWS | AWS CloudFormation | Amazon EMR | Ansible | Apache Airflow401K employee contribution | Employee assistance program | Flexible Time Away From Work | Health & medical benefits | Learning platformSenior-level Full TimeRemote US R2d ago
-
Analytics Engineer USD 80K-100KAgentic development | Aggregations | BI platform | BigQuery | CTEsDental insurance | Flexible paid time off | Health insurance | Remote work | Vision insuranceMid-level Full TimeUnited States R2d ago