Senior Data Engineer
USA - IL (Remote), United States
R
USD 85K-152K (estimate) Senior-level Full Time
Tasks
- Apply version control and testing for data engineering
- Build data processing systems
- Create unified data models and schemas
- Design data pipelines
- Document data lineage and data flows
- Ensure data privacy, security, and regulatory compliance
- Ensure data quality, integrity, and reliability
- Evaluate new data technologies and frameworks
- Implement CI CD and automated deployments
- Implement ingestion transformation and storage
- Improve engineering capabilities through mentorship
- Integrate data from APIs databases event streams and third party systems
- Manage metadata for data governance
- Monitor and validate data workflows
- Optimize data workflows for performance and cost
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | Azure DevOps | DBT | DBT Core | Data Pipelines | Datadog | Dataflows Gen2 | Docker | Fabric Data Pipelines | Fabric Dataflows Gen2 | Fabric Lakehouse | Fabric Warehouse | Fabric notebooks | Fabric semantic models | Flink | GitHub Actions | Java | Jenkins | Kafka | Kubernetes | Microsoft Fabric | Microsoft Fabric Data Pipelines | Microsoft Fabric Dataflows | Microsoft Fabric Dataflows Gen2 | Microsoft Fabric Lakehouse | Microsoft Fabric Notebooks | Microsoft Fabric Semantic Models | Microsoft Fabric Warehouse | NoSQL | Python | SQL | Scala | Semantic models | Spark
Education
Roles
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R10d ago
-
GenAI Principal Engineer - Remote USD 145K-215KAI orchestration | API first | API-first design | AWS | Android401k matching | DEI focus | Development opportunities | Flexible schedule | Flexible time offSenior-level Full TimeUnited States, UNITED STATES, United States R7h ago
-
Senior Data Engineer USD 143K-229KAnalysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services Tabular | Azure DataMentorship | Remote work optionSenior-level Full TimeKansas City, MO, United States R12h ago
-
Databricks Pipeline Architect USD 150K-180KAWS Glue | AWS Lambda | AWS S3 | Agile | Amazon Web ServicesPublic trust clearance support | Remote workSenior-level Full TimeWork from home, VA, United States R12h ago
-
Tier 3 Network Systems Engineer (Remote) USD 80K-101KActive Directory | Ansible | Ansible Playbook | Apache HTTP | Apache HTTP ServerAfter hours availability | Customer support support | On-call rotation | Remote workMid-level Full TimeDallas, TX, US R12h ago
-
Senior Machine Learning Engineer USD 150K-200KDistributed Systems | Feature Engineering | Feature Selection | Language Models | Language Processing401k matching | Cell phone and internet stipend | Employee stock purchase plan | Flexible time off | Learning programsSenior-level Full TimeRemote - USA R1d ago
-
Senior Software Engineer - Data Platform USD 186K-218KAccess Control | Airflow | Apache Kafka | Apache Spark | CachingSenior-level Full TimeRemote - USA R1d ago
-
Senior-level Full TimeHybrid (Salt Lake City, UT, US) R1d ago
-
Robotics Perception Engineer USD 140K-204KC++ | CI/CD | Camera-based perception | Cameras | Cloud processingCompany-provided laptop | Dental insurance | Health insurance | Paid time off | Remote work optionMid-level Full TimeAtlanta, Georgia, United States - Remote R1d ago
-
Robotics Hardware Integration Engineer USD 120K-158KAWS IoT | AWS IoT Core | AWS IoT Greengrass | C++ | CANDirect impact on shipped products | Early-stage company | Equity | Health, dental, and vision insurance | Permissive time off policyMid-level Full TimeAtlanta, Georgia, United States - Remote R1d ago
-
Robotics Navigation and Control Engineer USD 160K-240KA Star | C++ | CI/CD | EKF | GazeboCompany laptop | Health, dental, vision benefits | Permissive time off | Remote work | Travel to Atlanta facility for hardware integrationSenior-level Full TimeAtlanta, Georgia, United States - Remote R1d ago
-
Sr. Full Stack Engineer – AI/ML USD 151K-220KAPI Design | Alerting | Architecture Documentation | Artificial Intelligence | Capacity PlanningSenior-level Full TimeRemote Office - KY, United States R1d ago
-
Agentic AI Engineering Intern USD 48K-86KAgent systems | Autogen | Automated testing | CI/CD | CrewAIEntry-level Full Time Internship6314 Remote/Teleworker US, United States R1d ago
-
Staff Data & Analytics Engineer USD 112K-165KAPI Integration | Data Governance | Data Modeling | Data Quality | Data ValidationAdoption Assistance | Disability insurance | Employee assistance program | Health and wellness programs | Life insuranceSenior-level Full TimeEvendale, United States R1d ago
-
AI Engineer USD 91K-175KAI Studio | AWS | Apache Spark | Azure | Azure AIHealth benefits | Incentive programs | Professional development | Remote work | Retirement benefitsSenior-level Full TimeWork at Home - Cincinnati - … R1d ago
-
AI Solutions Engineer, Global USD 130K-135KAI Services | Agentic Systems | Artificial Intelligence | Automated testing | Azure AI401k with company match | Employee assistance | Employee recognition | Life and AD D | Long-term disabilityMid-level Full TimeRemote - CO, United States R1d ago
-
Wildlife Health Lab Data Engineer USD 80K-93KAmazon Web Services | Cloud platform | Data Pipelines | Data Privacy | Data SecurityEmployee discounts | Paid Holidays | Paid vacation | Retirement contributions | Tuition assistanceMid-level Full TimeIthaca (Main Campus), United States R1d ago
-
AI Engineer USD 150K-215KAgent Orchestration | Agent systems | AgentOps | Amazon Bedrock | Azure OpenAIMid-level Full TimeRemote United States R1d ago
-
Senior Data Engineer USD 146K-180KAWS | AWS CDK | Amazon Redshift | Apache Airflow | CircleCI401k matching | Disability insurance | Flexible PTO | Free therapy access for employees and one household member | Friends and family discountSenior-level Full TimeNew York, NY (Hybrid) R1d ago
-
Staff Software Engineer, Ads Data Platform USD 221K-279KApache Airflow | Apache Spark | Big Data | DBT | DatabricksAnnual equity refresh grants | Equity grants | Flexible work location | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior Software Engineer, Data Platform USD 170K-205KAPIs | AWS | Amazon RDS | Data Integrity | Data Modeling401k matching | Dental insurance | Health & wellness stipend | Health insurance | Hybrid work environmentSenior-level Full TimeSan Francisco, CA (Hybrid), US (Remote) R1d ago
-
Senior Data Engineer USD 143K-229KAnalysis Services Tabular | Automation | Azure Data | Azure Data Factory | Azure DevOpsRemote workSenior-level Full TimeDenver, CO, United States R1d ago
-
Senior Data Engineer USD 143K-229KAnalysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services Tabular | Azure DataMentorship | Remote work | Team collaborationSenior-level Full TimeKansas City, MO, United States R1d ago
-
Senior AI Solution Engineer USD 160KAI workflows | API Integration | Agentic Systems | Automation | Data CurationRemote work | Significant onsite travelSenior-level Full TimeRemote (United States) R1d ago
-
Machine Learning Engineer USD 175K-225KA/B | A/B Testing | B testing | Bias detection | BigQueryCompany holidays | Dental insurance | Flexible paid time off | Home office support | Learning and development budgetSenior-level Full TimeUS Remote R1d ago