Lead Data Engineer - Enterprise Data & Analytics - Remote
Rochester, MN, United States
R
USD 120K-163K (estimate) Senior-level Full Time
Tasks
- Analyze unstructured datasets
- Automate manual processes
- Build data products
- Build test automation suites
- Communicate technical solutions
- Deliver in agile environment
- Design data pipeline architecture
- Develop production data pipelines
- Establish architectural principles
- Evaluate technical feasibility
- Facilitate cross-team communication
- Implement data quality monitoring
- Implement engineering standards
- Improve scalability of infrastructure
- Lead technical discussions
- Maintain production codebases
- Mentor engineers
- Optimize data delivery
- Perform root cause analysis
- Prototype data pipelines
- Prototype new technologies
- Review production code
- Select design patterns
Perks/Benefits
- Continuing education
- Dental insurance
- FSA
- HSA
- Health insurance
- Paid time off
- Retirement plan
- Vision insurance
Skills/Tech-stack
Amazon Web Services | Apache Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | Avro | Azure Boards | Azure Pipelines | CI/CD | Cloud Dataflow | Cloud platform | Data Modeling | Data Quality | Delta Lake | Docker | Flink SQL | Git | GitHub Actions | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Cloud Platform | Google Composer | Infrastructure as Code | Jenkins | Jira | Kubernetes | Microsoft Azure | Monitoring | NoSQL | ORC | Observability | Parquet | Python | Ray | Relational databases | SQL | SharePoint | Test automation | Unit Testing | Vertex AI | Web Services | “as-code”
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percent timeSenior-level Full TimeRemote - Washington D.C. R17h ago
-
Senior Data Scientist - Ontology USD 128K-170KCypher | Data integration | Data profiling | Description logics | Entity ResolutionSenior-level Full TimeOffice Location or Remote - USA R19h ago
-
Analytics Lead, Safety Reporting USD 104K-131KDashboarding | Data Documentation | Data Quality | Data Reconciliation | Data analytics401k match | Child care benefits | Commuter benefits | Dental insurance | Family building benefitsSenior-level Full TimeSan Francisco, CA R19h ago
-
Senior Data Science Engineer USD 160K-175KAPI Development | Apache Airflow | Apache Spark | CI/CD | DBTFlexible work optionsSenior-level Full TimeRemote (United States) R20h ago
-
Accounting Analytics & BI Engineer USD 220K-270KAirflow | Analytics engineering | Business Intelligence | DBT | Data ModelingFlexible working hours | Generous vacation | Health benefits | Hybrid work policy | Optional equity donation matchingMid-level Full TimeSan Francisco, CA R21h ago
-
Staff Machine Learning Engineer USD 176K-308KAPI Design | Distributed Systems | Generative AI | Hybrid search | Inference Optimization401k plan with company match | ESPP | Family Leave Program | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R21h ago
-
Senior Analytics Engineer, Marketing Sciences USD 100K-125KAmazon Kinesis | DBT | Docker | JSON | Kafka401k match | Dental insurance | Employee resource groups | Flexible time off | Life and disability insuranceSenior-level Full TimeUnited States R21h ago
-
Senior Software Engineer - Storage USD 243K-295KActive architecture | Active-active Architecture | Active/Active | Alertmanager | As-a-ServiceSenior-level Full TimeSan Mateo, CA, United States R22h ago
-
AI Engineer/Scientist, Staff USD 185K-250KAPIs | Agent Frameworks | Argo CD | Attribution methods | CI/CD401k match | Comprehensive health coverage | Hybrid work environment | Paid Company Holidays | Parental leaveSenior-level Full TimeAustin, Texas, United States; Menlo Park, … R22h ago
-
Principal AI Engineer USD 182K-242KAPI | Access Control | Access Management | Air Gapped Computing | Air-gapped401k match | Dental insurance | Flexible-hybrid work | Health insurance | Life insuranceSenior-level Full TimeAustin, Texas, United States; Menlo Park, … R22h ago
-
AI Engineer/Scientist - Staff USD 185K-242KAPI Development | Agent Frameworks | Argo CD | Artificial Intelligence | Attribution401k match | Equity ownership | Flexible-hybrid work | Health insurance | Life insuranceSenior-level Full TimeAustin, Texas, United States; Menlo Park, … R22h ago
-
Data Engineer Intern USD 44K-54KBusiness Intelligence | Cloud Data | Cloud Data Warehouse | Data Modeling | Data VisualizationHybrid workEntry-level InternshipWeave - Headquarters (Lehi, UT) R23h ago
-
Technical Delivery Lead USD 157K-235KAutomated testing | CI/CD | Cloud automation | CloudWatch | Dynatrace401k employer match | AD D coverage | Dental insurance | Disability coverage | Employer-paid retirement planSenior-level Full TimeRemote, United States R23h ago
-
Machine Learning Engineer USD 161K-200KA/B | A/B Testing | B testing | Collaborative Filtering | Content-Based Filtering401k matching | Disability insurance | Fertility benefits | Health insurance | Life insuranceSenior-level Full TimeBellevue, WA R23h ago
-
AWS | Ansible | Automation | BAM | Bioinformatics401k match | Commuter benefits | Employee referral program | Fertility care benefits | Free employee genetic testingSenior-level Full TimeUS Remote R23h ago
-
Data Scientist USD 132K-202KDBT | Data Engineering | Data pipeline | Databricks | Feature Engineering401k | Medical/Dental/Vision insurance | Paid time off | Short Term Incentive ProgramSenior-level Full TimeWorcester, MA, United States R23h ago
-
Algorithm Engineer USD 150K-170KCI/CD | Deep learning | Digital Signal | Digital Signal Processing | DockerPTO | Remote workMid-level Full TimeBoston, MA / Remote R23h ago
-
Software Engineer, Data USD 146K-219KAirflow | BigQuery | CI/CD | Cloud platform | Data ModelingFlexible office schedule | Flexible time off | Insurance plans | Recognition programs | Wellness appsSenior-level Full TimeHybrid-Palo Alto, CA R1d ago
-
Machine Learning Engineer (Autonomy) USD 140K-180KC++ | Computer Vision | Data Pipelines | Embedded Systems | GNSSEntry-level Full TimeSan Francisco HQ R1d ago
-
Senior Engineer, Platform & Data USD 150K-200KAWS | Concurrency | Consistency | Containerization | Data Management401k | Employee insurance coverage | Flexible PTO | Stock optionsSenior-level Full TimeSanta Clara R1d ago
-
Mid-level Full TimeRemote, United States R1d ago
-
AI Engineer USD 200K-250KAnomaly Detection | Chunking | Classification | Confidence estimation | Context engineeringSenior-level Full TimeSan Jose Office (HQ) R1d ago
-
Senior-level Full TimeHerndon, VA; Information Technology; Tysons, VA; … R1d ago
-
Senior AI/ML Full Stack Engineer USD 130K-176KAWS | AWS Bedrock | Airflow | Authentication | AuthorizationFully remote | W2 onlySenior-level Full TimeRemote, MN; Information Technology R1d ago
-
CDC | Change Data Capture | Data Capture | Data Ingestion | Data Ingestion PipelinesContract 12 plus months | TeleworkMid-level Full TimeRemote, Texas; Information Technology R1d ago