Data Engineer
Tasks
- Architect data flows from IoT devices through AWS
- Build ETL ELT pipelines for batch processing
- Create and maintain data transformations
- Create architectural documentation
- Define data modeling standards
- Design AWS data platform improvements
- Design analytics ready data models for product teams
- Design and build dashboards for IoT metrics and insights
- Design data models for analytics and reporting
- Develop real time near real time IoT ingestion pipelines
- Enable real-time and batch analytics
- Establish data governance frameworks
- Evolve IoT data architecture
- Implement data orchestration and scheduling
- Monitor and troubleshoot data pipeline failures
- Optimize query performance for analytics workloads
- Process device telemetry and usage patterns
- Translate requirements into scalable data solutions
- Write production quality data engineering code
Perks/Benefits
- 401k match
- Backup child and eldercare days
- Company holidays
- Dental insurance
- Employee stock purchase program
- Flexible spending accounts
- Health savings account
- Life insurance
- Long-term disability insurance
- Medical insurance
- Paid time off
- Parental leave
- Pet insurance
- Pre paid legal insurance
- Product Discounts
- Referral bonus program
- Short-term Disability Insurance
- Vision insurance
Skills/Tech-stack
AWS | AWS CDK | Airflow | Athena | Avro | CI/CD | CI/CD for data | CI/CD for data pipelines | CloudFormation | CloudWatch | Data Architectures | Data Governance | Data Modeling | Data Pipelines | Data Quality | Data Transformation | Data Warehousing | Data orchestration | DataOps | Database Design | Delta Lake | Dimensional Modeling | ELT | ETL | Git | Glue | Iceberg | Infrastructure as Code | JSON | Kinesis | Lakehouse | MWAA | Parquet | Performance Tuning | Python | Query Optimization | Real Time | Real-time analytics | Redshift | S3 | SQL | Scheduling | Step Functions | Streaming Data | Streaming data architectures | Version control | “as-code”
Education
Roles
Related jobs
-
AI/ML Engineer USD 117K-171KA/B | A/B Testing | API Development | AWS | B testingDental insurance | Health insurance | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US2h ago
-
Cloud Data Engineer USD 92K-113KAgile | Apache Airflow | Beam | BigQuery | Cloud ComposerOnsite workMid-level Full TimeAda, MI, United States, 493553h ago
-
Forward Deployed Machine Learning Engineer USD 180K-300KAPI Design | Cloud Computing | Deep learning | Diffusion Models | Fine TuningIn-person collaboration days | Remote work flexibility | Travel cost coverageSenior-level Full TimeSan Francisco (USA) R9h ago
-
Senior ML Engineer, Fauna USD 184K-250KComputer Vision | Data Quality | Distributed Training | Edge Deployment | Evaluation PipelinesSenior-level Full TimeNew York, New York, USA10h ago
-
Forward Deployment Engineer - Gen AI USD 162K-224KAWS Bedrock | AWS SageMaker | Autogen | Azure OpenAI | ChromaCareer development opportunities | Individual responsibility | Travel to client sitesMid-level Full TimeNew York, New York, United States10h ago
-
Specialist Solutions Architect - AI/ML USD 180K-247KAI guardrails | Amazon Web Services | Apache Spark | Artificial Intelligence | Cloud ComputingMentorship | Remote work | Technical training | Travel up to 30 percentSenior-level Full TimeUnited States11h ago
-
Lead Data Engineer USD 115K-130KAgile | Apache Airflow | Azure Data | Azure Data Factory | Cloud Orchestration401k | Dental insurance | Medical insurance | Paid leave | Tuition reimbursementSenior-level Full TimeUniversal City, CALIFORNIA, United States11h ago
-
Principal AI Platform Engineer USD 167K-220KAgent Orchestration | Backend Development | Braintrust | Cost Optimization | Data PipelinesEquity | Flexible Token Limits | Health, dental, vision coverage | Unlimited paid time offSenior-level Full TimeSan Francisco, California R11h ago
-
Specialist Solutions Architect - Data Warehouse USD 139K-247KAWS | Azure | Cloud platform | Data Governance | Data ModelingSenior-level Full TimeUnited States12h ago
-
Machine Learning Engineer USD 168K-198KAPIs | Amazon SageMaker | Anthropic API | Asynchronous processing | CI/CDAdoption reimbursement | Commuter stipend | Fertility reimbursement | Flexible PTO | Learning and development allowanceSenior-level Full TimeSan Francisco, California, United States12h ago
-
AWS MSK | Amazon Kinesis | Apache Flink | Apache Kafka | AutomationSenior-level Full TimeUSA - Atlanta, GA; USA - …12h ago
-
Cyber Data Engineer USD 140K-145KAWS | ArcSight | Bash | Cribl | DHCP401k match | Accrued PTO | Health/Dental/Vision | Life insurance | Long-term disabilitySenior-level Full TimeSpringfield, VA13h ago
-
Staff Software Engineer - Container Platform USD 236K-339KAWS | Azure | Cloud automation | Cluster Lifecycle Management | Cluster lifecycleSenior-level Full TimeUS-CA-Menlo Park13h ago
-
Ansible | ArgoCD | CI/CD | Chef | Configuration ManagementSenior-level Full TimeNew York, NY, United States13h ago
-
Assistant Vice President, Data Engineer USD 142K-213KAPI Integration | Authentication | Authorization | Azure Data | Azure Data FactoryExecutive-level Full TimeChicago, IL13h ago
-
Senior Utilities Data Analyst USD 114K-194KAI | Anomaly Detection | ArcGIS API | ArcGIS API for JavaScript | ArcGIS API for PythonEmployee Ownership Plan | Medical leave | Military Leave | Paid Holidays | Parental leaveSenior-level Full TimeWilmington, North Carolina, United States14h ago
-
AI / Computer Vision (IC) USD 200K-357KComputer Vision | Edge inference | GPS/IMU | Language Models | LidarComprehensive health plans | Parental leave plans | Professional development stipend | Remote work optionSenior-level Full TimeRemote - US R14h ago
-
Mid-level Full TimeWashington, District of Columbia, United States14h ago
-
Junior Data Engineer USD 120K-160KAPI Design | Data Modeling | Database Design | Docker | GitEmployee benefits for families | On-site work | Profit sharingEntry-level Full TimeChicago, Illinois, United States15h ago
-
Sr/Staff Data Engineer - On-site in NYC! USD 175K-230KAWS | Apache Iceberg | Apache Kafka | Apache Spark | DBTEquity | Hybrid flexibility | Mission-driven workSenior-level Full TimeUSA15h ago
-
Applied AI Engineer USD 110K-163KAI Evaluation | API Integration | AWS Bedrock | Agentic Workflows | Agile ScrumGenerous benefits | Hybrid work | Incentives | Learning and trainingMid-level Full TimeKing of Prussia, Pennsylvania, United States15h ago
-
Delivery Solutions Architect - Digital Native Business USD 180K-247KAccount Management | Business Analysis | Distributed Systems | KPI Reporting | Program ManagementHybrid work | Travel up to 30%Senior-level Full TimeRemote - California; Remote - Oregon; … R16h ago
-
Senior-level Full TimeSan Diego, CA16h ago
-
Senior Engineer Embedded System Engineer USD 94K-125K8D methodology | A3 problem solving | Board Design | Bus Traces | Bus analyzerLife, accident, and disability insurance | Medical/Dental/Vision insurance | Paid sick leave | Paid vacation time | Tax-advantaged flexible spendingSenior-level Full TimeIrvine, CA, United States16h ago
-
A/B | A/B Testing | APIs | Airflow | B testingSenior-level Full TimeUnited States16h ago