Lead Data Engineer - Enterprise Data & Analytics - Remote
Rochester, MN, United States
R
USD 120K-163K (estimate) Senior-level Full Time
Tasks
- Analyze unstructured datasets
- Automate manual processes
- Build data products
- Build test automation suites
- Communicate technical solutions
- Deliver in agile environment
- Design data pipeline architecture
- Develop production data pipelines
- Establish architectural principles
- Evaluate technical feasibility
- Facilitate cross-team communication
- Implement data quality monitoring
- Implement engineering standards
- Improve scalability of infrastructure
- Lead technical discussions
- Maintain production codebases
- Mentor engineers
- Optimize data delivery
- Perform root cause analysis
- Prototype data pipelines
- Prototype new technologies
- Review production code
- Select design patterns
Perks/Benefits
- Continuing education
- Dental insurance
- FSA
- HSA
- Health insurance
- Paid time off
- Retirement plan
- Vision insurance
Skills/Tech-stack
Amazon Web Services | Apache Airflow | Apache Flink | Apache Hive | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | Avro | Azure Boards | Azure Pipelines | CI/CD | Cloud Dataflow | Cloud platform | Data Modeling | Data Quality | Delta Lake | Docker | Flink SQL | Git | GitHub Actions | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Cloud Platform | Google Composer | Infrastructure as Code | Jenkins | Jira | Kubernetes | Microsoft Azure | Monitoring | NoSQL | ORC | Observability | Parquet | Python | Ray | Relational databases | SQL | SharePoint | Test automation | Unit Testing | Vertex AI | Web Services | “as-code”
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R23d ago
-
AI & Machine Learning Vice President USD 120K-220KAWS | Alteryx | Anomaly Detection | Azure | C#401k | Dental insurance | Disability insurance | Health insurance | Hybrid work modelExecutive-level Full TimeUnited States R18h ago
-
Data Governance Lead - Remote in Colorado USD 250K-300KAI Governance | Access Control | CCPA | Compliance Management | Data Access Control401k match | Dental insurance | Health insurance | Paid time off | Training and developmentSenior-level Full TimeColorado R19h ago
-
Lead Data Analyst USD 100K-139KAmazon Redshift | DBT | Data Governance | Data Lakehouse | Data Modeling401k match | Disability insurance | Flexible schedule | Health insurance | Life insuranceSenior-level Full TimePlantation, Florida, United States R19h ago
-
Staff Machine Learning Engineer, Applied Research USD 189K-389KC++ | Graph Neural Networks | Information Retrieval | Java | Language ProcessingSenior-level Full TimeSan Francisco, CA, US; Remote, US R19h ago
-
Director, Data Analyst/BI Engineer USD 138K-175KAWS | Access Control | Aggregated Event Measurement | Airflow | BigQuery401k match | Healthcare Dental Vision | PTO | Paid Holidays | Parental leaveExecutive-level Full TimeUnited States R20h ago
-
Principal AI Engineer USD 185K-265KAPI Integration | Agent systems | Artificial Intelligence | Cloud Native | Cloud-native ArchitecturesEducation reimbursement | Health plans | Paid time off | Parental leave | Remote workSenior-level Full TimeRemote - USA R20h ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Cloud Computing | Data Association401k match | Dental insurance | Emotional & mental wellness support | Employee resource groups | Fitness programsSenior-level Full TimeSeattle, Washington, United States R20h ago
-
Data Engineer USD 160K-200KAWS | Apache Spark | Azure | CI/CD | DBT401k match | Continuing education support | Employee assistance program | Flexible spending accounts | Generous paid time offSenior-level Full TimeAuburn Hills, MI, US R20h ago
-
Senior Data Engineer II, AI Native USD 148K-216KAmazon Web Services | Apache Airflow | Apache Spark | Azure | BigQuery401k matching | Dental insurance | Disability insurance | Employee assistance program | Equipment reimbursementSenior-level Full TimeRemote, USA R20h ago
-
API Design | AWS | Apache Airflow | Apache Flink | Apache KafkaDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R21h ago
-
Senior Data Engineer USD 115K-175KAWS Fargate | AWS Glue | AWS IAM | AWS Lambda | AWS MWAACharitable giving program | Company-Paid Holidays | Dental insurance | Flexible PTO | Life insuranceSenior-level Full TimeMassachusetts - Boston R22h ago
-
Autonomy | C++ | DDS | Data Ingestion | Edge Computing401k | Healthcare coverage | Paid Holidays | Paid time off | Phone stipendMid-level Full TimeSan Carlos - Hybrid R23h ago
-
Senior Analytics Engineer USD 148K-218KAutomation | BI tools | CCPA | CI/CD | DBTDental insurance | Equity | Medical insurance | Remote work | Vision insuranceSenior-level Full TimeRemote, USA ; Remote, Canada R23h ago
-
A/B | A/B Testing | API Development | AWS Bedrock | Access Control401k plan | Healthcare premium coverage | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R23h ago
-
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS CodeBuild401k | PTO | Paid Company Holidays | Phone stipend | Wellness stipendSenior-level Full TimeSan Carlos - Hybrid R23h ago
-
Autonomy | C++ | CPU GPU | CPU GPU Debugging | DDS401k | Healthcare | Paid Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R23h ago
-
AI Engineer II USD 125K-145KAPI Gateway | AWS | AWS Bedrock | AWS Lambda | Amazon APICareer advancement | Employee recognition | LinkedIn Learning Platform | Open PTO | Paid HolidaysMid-level Full TimeRemote US R23h ago
-
Apache Airflow | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Kafka StreamsContinuing education | Dental insurance | Flexible spending account | Health savings account | Medical insuranceSenior-level Full TimeRochester, MN, United States R23h ago
-
AI machine learning | AWS | Analytics | Azure | Azure DevOpsHybrid workSenior-level ContractAustin, TX, United States R1d ago
-
Principal AI Engineer (Remote) USD 128K-200KAPI Gateways | Agent Orchestration | Artificial Intelligence | BigQuery | By DesignAfter hours incident support | Occasional overtime | Occasional travel | Remote workSenior-level Full TimeOak Brook, IL, United States R1d ago
-
Cleared Hybrid Data Engineer (5418) USD 103K-171KAPI strategy | AWS | AWS Glue | AWS Redshift | Access ControlHealth insurance | Paid leave | RetirementSenior-level Full TimeHanover, MD R1d ago
-
APIs | AWS | Agentic AI | Azure | Claude401k | Dental insurance | Fully remote US based | Generous PTO | HolidaysSenior-level Full TimeRemote USA, United States R1d ago
-
Principal Data Engineer USD 190K-210KAmazon Kinesis | Containerization | Helm | Infrastructure as Code | JuliaEquity | In person office hubs | PTO | Remote workSenior-level Full TimeBoston, MA / Remote R1d ago
-
Principal Software Engineer, Data USD 190K-210KAmazon Kinesis | Containerization | Data Engineering | Event Processing | HelmEquity | PTO | Remote workSenior-level Full TimeBoston, MA / Remote R1d ago