Data Engineer
Tasks
- Build data platforms
- Conduct architecture discussions
- Conduct discovery sessions
- Conduct requirements workshops
- Conduct solution reviews
- Design data platforms
- Develop batch data ingestion pipelines
- Develop data transformation workflows
- Develop streaming data ingestion pipelines
- Engineer data solutions
- Implement Lakehouse architecture
- Implement dimensional modeling
- Optimize data ingestion pipelines
- Optimize data platforms
- Present recommendations to leadership
- Recommend DevOps best practices
- Recommend data governance best practices
- Recommend data lineage best practices
- Recommend data modeling best practices
- Recommend monitoring best practices
- Recommend security best practices
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Apache Spark | Automated testing | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Kubernetes | Azure Kubernetes Service | Azure SQL | Azure Synapse | Azure Synapse Analytics | Batch Processing | Containers | Cosmos DB | Data Factory | Data Governance | Data Ingestion | Data Lineage | Data Monitoring | Data Transformation | Databricks | Delta Lake | Delta Sharing | DevOps | Dimensional Modeling | Docker | GitHub | Kubernetes | Kubernetes Service | Lakehouse | Medallion Architecture | Microsoft Azure | Microsoft Fabric | Power BI | PySpark | Python | SQL | Spark SQL | Stream processing | Synapse Analytics | Unity Catalog
Education
Roles
Related jobs
-
Senior Software Engineer, AI/ML GenAI, Google Cloud USD 174K-252KC plus plus | Computer Vision | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA1h ago
-
Senior Software Engineer, AI/ML GenAI, Google Play USD 174K-252KAndroid | C++ | Computer Vision | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA1h ago
-
Staff Software Engineer, AI/ML GenAI, Google Cloud USD 207K-300KAlgorithms | C++ | Cloud infrastructure | Computer Vision | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA; San Francisco, CA, …1h ago
-
Senior Software Engineer, AI/ML, Google Workspace USD 174K-252KC++ | Data Processing | Debugging | Language Processing | ML InfrastructureSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …1h ago
-
Software Engineer III, AI/ML, Google Fi USD 147K-211KData Processing | Debugging | Distributed Systems | Java | Language ProcessingSenior-level Full TimeMountain View, CA, USA; San Francisco, …1h ago
-
Cloud & Data Engineer USD 83K-187KAWS | Azure | Big Data | CI/CD | Container Security401k savings plan | Disability insurance | Employee assistance program | Flexible vacation | Life insuranceEntry-level Full TimeLexington, MA, US4h ago
-
AWS Data Engineer USD 118K-178KAWS CloudFormation | AWS Data | AWS Data Migration | AWS Data Migration Service | AWS EMR401k matching | Dental insurance | Education assistance program | Health insurance | Holiday payMid-level Full TimeWheeling, IL, US6h ago
-
Vertical AI Lead USD 150K-250KAPI Integration | Agentic Systems | Artificial Intelligence | Customer discovery | Go-to-marketBenefits | Equity | Visa sponsorshipSenior-level Full TimeNew York City / San Francisco9h ago
-
AI Solution Principal Systems Development Engineer USD 148K-222KCluster management | Containerization | GPU Computing | Generative AI | Hardware/Software Integration401k plan | Choice of medical coverage | Fitness reimbursement | Generous Time Off Programs | Team member discounts on Dell productsSenior-level Full TimeAustin, Texas, United States, United States12h ago
-
Lead Cloud Data Engineer USD 116K-155KAWS Glue | AWS IAM | AWS Lake Formation | Amazon Athena | Amazon AuroraDental insurance | Hybrid work | Life insurance | Medical insurance | Paid time offSenior-level Full TimeFL - Saint Petersburg - 880 …12h ago
-
AI Search | Azure AI | Azure AI Search | CI/CD | Chroma401k | Dental insurance | Medical insurance | Paid sick hours | Vision insuranceSenior-level Contract Full TimeRidgefield Park, NJ, United States12h ago
-
API Security | AWS | Adversarial inputs | Agent Frameworks | Application SecurityCiti Bike membership | Flexible paid time off | Gym membership | Health and mental health services | Home office stipendSenior-level Full TimeSan Francisco, California, United States; Seattle, …13h ago
-
APIs | Artificial Intelligence | Automation | Decision support | Generative AI401k | Cafe Amenities | Fitness Center | Health insurance | Recreational facilitiesEntry-level Full TimeBroomfield, CO, United States15h ago
-
Applied AI Engineer (AI Adoption) USD 200K-250KAI Evaluation | Agent Design | Automation | LLM APIs | Machine LearningDental insurance | Group pension scheme | Income protection | Life assurance | Paid HolidaysMid-level Full TimeNew York, Chicago, London15h ago
-
Sr. Staff Embedded AI Engineer USD 165K-200KBare Metal | C# | C++ | CMSIS NN | Code generationEmployee resource groups | Flexible work environment | Hybrid schedule | Remote work optionSenior-level Full TimeColumbia, MARYLAND, United States16h ago
-
Senior Software Engineer, Robotics USD 141K-194KAlgorithms | C++ | CI/CD | Computer Vision | Constraint SatisfactionCompany holidays | Health insurance | Learning reimbursement | Life insurance | Long-term disabilitySenior-level Full TimeTorrance, California, United States16h ago
-
Senior Data Engineer USD 157K-218KAWS Athena | AWS EMR | AWS Glue | AWS Lambda | Amazon S3Beverages | Commuter stipend | Hybrid work schedule | Lunch stipend | Relocation stipendSenior-level Full TimeDenver, Colorado, United States; San Francisco, …16h ago
-
Principal Machine Learning Engineer USD 157K-223KA/B | A/B Testing | AI Agents | Airflow | B testingSenior-level Full TimeUS TX Austin16h ago
-
Senior Forward Deployed Engineer (AI/ML) USD 140K-174KBenchmarking | CUDA | Continuous batching | CrewAI | DatabasesConference reimbursement | Employee assistance program | Flexible time off | LinkedIn Learning access | Local Employee MeetupsSenior-level Full TimeSeattle R16h ago
-
Senior Forward Deployed Engineer (AI/ML) USD 140K-174KArtificial Intelligence | CUDA | Continuous batching | CrewAI | DatabasesConference reimbursement | Employee assistance program | Flexible time off | LinkedIn Learning access | Remote workSenior-level Full TimeSan Francisco R16h ago
-
Data Engineer USD 127K-175KAWS | Airbyte | Airflow | Alerting | CI/CD401k contribution | Dental insurance | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeUnited States - Remote R16h ago
-
Senior Software Engineer, Storage Content USD 198K-248KAlerting | Apache Spark | Bigtable | Cloud Computing | Content streamingSenior-level Full TimeRedwood City, California16h ago
-
Sr. AI Engineer USD 152K-183KAPI Development | AWS | Agent Frameworks | Agentic AI | Artificial Intelligence401k plan | Dental insurance | Hybrid work | Medical insurance | Tuition reimbursementSenior-level Full TimeUS - Orlando16h ago
-
Advanced Data Engineer USD 21KApplication Programming | Application Programming Interfaces | Artificial Intelligence | Big Data | Cloud ComputingEmployee assistance program | Employee discounts | Holiday pay | Paid time off | Sick paySenior-level Full TimeBlue Ash, OH, United States16h ago
-
Staff Engineer - AI Engineer USD 155K-175KERP | Hugging Face | Langchain | MES | ModbusContract extension possible | Remote workSenior-level Full TimeRemote, REMOTE, United States R16h ago