Data Engineer - Sr. Consultant level
Tasks
- Architect large-scale data pipelines
- Build automation frameworks and reusable components
- Build lakehouse structures
- Design scalable data models
- Develop distributed compute solutions
- Develop self-service tooling
- Evaluate emerging data engineering tools
- Implement data ingestion frameworks
- Improve data quality observability governance reliability performance
- Lead design and development of data processing systems
- Lead multi-team technical projects
- Mentor engineers
- Modernize data lake and lakehouse
- Optimize pipelines
- Perform platform tuning and troubleshooting
- Provide technical guidance in design reviews code reviews
- Recommend platform enhancements
- Support cloud migrations
Perks/Benefits
- 401k
- Dental insurance
- FSA/HSA
- Life insurance
- Medical insurance
- Paid time off
- Vision insurance
- Wellness program
Skills/Tech-stack
AWS | Apache Spark | CI/CD | Cloud Migration | Cloud platform | Data Lake | Data Modeling | Data Warehousing | Databricks | Delta Lake | Distributed query | Distributed query engines | ELT | ETL | Google Cloud | Google Cloud Platform | Hadoop | Hive | Microsoft Azure | NoSQL | Orchestration | Presto | PySpark | Python | Query engines | Relational databases | SQL | Scala | Spark SQL | Trino
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R14d ago
-
AI Safety | AI Search | AWS SageMaker | Azure AI | Azure AI Search401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States5h ago
-
Data Engineer USD 92K-125KAWS EMR | AWS Glue | AWS Lambda | AWS S3 | Amazon Kinesis401k match | Comprehensive benefits | Flexible PTO | Gym reimbursement | Mental health supportMid-level Full TimeHerndon, VA, United States8h ago
-
Active Learning | Bayesian optimization | Coarse Grained Modeling | Computer Vision | Data Pipelines401k eligibility | Employee assistance program | Health and wellness benefits | Paid Holidays | Paid parental leaveSenior-level Full TimeMentor, OH, United States9h ago
-
Sr. Tech Lead, GTM Applied AI & Analytics USD 150K-243KAirflow | Databricks | Fine Tuning | Langchain | Language ModelsSenior-level Full TimeSan Francisco, CA, United States10h ago
-
Technical Support Engineer 2 (Remote) USD 70K-100KActive Directory | Ansible | Apache | Backup and Patching | ColdFusion401k match | Dental insurance | Flexible schedules | Health insurance | Life insuranceMid-level Full TimeDallas, TX, US R12h ago
-
AI Engineer USD 118K-204KAWS | Data Analysis | Data Modeling | Data Quality | Exploratory Data AnalysisMid-level Full TimeAnnapolis Junction, MD12h ago
-
Gen AI Architect USD 125K-188KAI Model Deployment | AI model | API Integration | Azure OpenAI | Data SecuritySenior-level Full TimeNew York, United States15h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure SynapseSenior-level Full TimeMinnetonka, MN.15h ago
-
AWS Cloud Engineer / Administrator USD 120K-139KAWS | AWS Bedrock | AWS Lake Formation | Amazon CloudWatch | Amazon EC2401k plan | Disability insurance | Employee assistance program | Employee stock purchase plan | Health savings accountMid-level Full TimeSan Jose, CA, United States16h ago
-
Machine Learning Engineer, Risk Data Mining - USDS USD 145K-337KData Mining | Feature Engineering | Interpretability | Language Processing | Machine LearningEntry-level Full TimeSan Jose, California, United States16h ago
-
Senior Software Engineer, Infrastructure, Infra Spanner USD 174K-252KC++ | Concurrency | Data Corruption | Data corruption diagnosis | Database InternalsSenior-level Full TimeSunnyvale, CA, USA17h ago
-
Mid-level Full TimeSunnyvale, CA, USA17h ago
-
AI Agents | Artificial Intelligence | C++ | Data Monitoring | Data ProcessingMid-level Full TimeSunnyvale, CA, USA17h ago
-
Energy Market Optimization Engineer USD 136K-198KAIMMS | Electricity Market Simulation | Electricity Markets | Electricity market | GAMs401k matching | Dental insurance | Disability insurance | Employee assistance program | Employee business networksMid-level Full TimeHolyoke, MA, 01040, USA20h ago
-
Embedded Software Engineer 4 USD 90K-135KAutomated testing | C++ | CI/CD | Linux | Memory Management401k employer match | Dental insurance | Disability coverage | Life insurance | Medical insuranceMid-level Full TimeChillicothe, IL21h ago
-
Senior Machine Learning Engineer - Energy USD 145K-155KAnomaly Detection | Apache Spark | Azure Databricks | Azure DevOps | Azure Machine Learning401k match | Career advancement opportunities | Charitable Matched Giving | Commuter benefits | Company Seeded HSASenior-level Full TimeOakland, CA, United States1d ago
-
Data Engineer USD 65K-105KAutomated testing | Azure DevOps | BigQuery | CI/CD | Cloud ComposerCompany-Paid Holidays | Disability insurance | Employee assistance programs | Life insurance | Medical, dental & vision coverageMid-level Full TimeNashville, TN, US1d ago
-
NumPy | Pandas | Python | SciPy | Scikit-learnFlexible schedule | Freelance projects | Part-time engagement | Stable internet requiredSenior-level FreelanceUnited States - Remote R1d ago
-
Sr. Engineer - Data Analytics (Hybrid) USD 140K-215KAmazon Web Services | Apache Airflow | Apache Kafka | CQL | CassandraCompetitive vacation and holidays | Employee networks and volunteer opportunities | Employee wellness programs | Hybrid work | Paid adoption leaveSenior-level Full TimeUSA NY Remote, United States R1d ago
-
Senior AI Business Process Engineer USD 128K-182KAPI | Agile | BPMN 2.0 | Backlog Management | Camunda 8Career development opportunities | Equal employment opportunitySenior-level Full TimeDallas, Texas, United States - Remote R1d ago
-
API Design | Distributed Systems | Kubernetes | Microservices | PostgreSQLDaily catered lunch | Medical, dental & vision coverage | Unlimited PTO | Visa supportSenior-level Full TimeSan Francisco, CA; Hybrid R1d ago
-
Research Data Engineer II USD 77K-115KAcceptance Testing | Artificial Intelligence | C# | CI/CD | Cloud ComputingEntry-level Full TimeSaunders Research Building, United States1d ago
-
Senior Power BI Developer USD 130K-150KAzure DevOps | Confluence | GitLab | Jira | OracleCommuter benefits | Dental insurance | Flexible work arrangements | Health insurance | Higher education certification policySenior-level Full TimeNew York, NY, United States1d ago
-
Microsoft Analytics Data Engineer Senior Consultant USD 96K-158KAccess Control | Azure | Azure Databricks | Azure Networking | Azure Storage401k match | Health, dental, and vision insurance | Hybrid work model | Life and accident insurance | Long-term disabilitySenior-level Full TimeMINNEAPOLIS, United States R1d ago