Lead Data Engineer (P4519)
Tasks
- Build REST APIs
- Build data storage and transformation pipelines
- Collaborate with Product and Data Science
- Design data ingestion solutions
- Develop Databricks based solutions
- Develop data distribution services
- Drive agile delivery using Scrum
- Host services in Kubernetes
- Implement ETL workflows
- Mentor junior engineers
- Oversee engineering teams
- Perform unit and integration testing
Perks/Benefits
Skills/Tech-stack
Agile | Azure | Data Warehousing | Databricks | Databricks Workflows | ETL | Integration Testing | JSON | Kubernetes | PySpark | Python | REST API | SQL | Scrum | Spark | Unit Testing
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Regions
Countries
States
Related jobs
-
Junior Data Engineer USD 48K-54KAzure | Azure Data | Azure Data Services | CI/CD | DBTHealth and wellness programs | Inclusive culture | Medical dental and disability benefits | Retirement savings programEntry-level Full TimeAtlanta, GA, US, 303386h ago
-
API Integration | AWS | Accessibility | Azure | D3.jsCollaborative environment | Contract extension | Flexible international environment | Fully remote work | High autonomySenior-level Full TimeCanada R8h ago
-
Agentic AI Engineer (Boston, Hybrid) USD 319K-350KAI orchestration | AWS | Autogen | Azure | CrewAIEquity | Health benefits | Hybrid workMid-level Full TimeBoston R10h ago
-
Senior-level Full TimeRemot, USA, United States R10h ago
-
Staff Security Software Engineer, AI Security USD 190K-267KAI Security | AI security tooling | AWS | Adversarial ML | Audit LoggingSenior-level Full TimeRemote - California R13h ago
-
Senior Software Engineer, Observability USD 200K-280KAWS | Ansible | Azure | CI/CD | ClickHouseHealth insurance | Remote work flexibility | Startup equitySenior-level Full TimeSan Francisco13h ago
-
GenAI / Agentic AI Developer USD 130KAI Search | AWS Bedrock | Agent Orchestration | Agent systems | Anthropic ClaudeMid-level Full TimeNew York, US13h ago
-
AI Governance | AI Threat Detection | AI red teaming | Adversarial Machine Learning | Anomaly DetectionComprehensive benefits | Remote work flexibilitySenior-level Full TimeRemote - California R13h ago
-
Staff Data Engineer USD 166K-230KAWS | AWS EKS | AWS Glue | Amazon Athena | Amazon EMRFertility adoption and parental planning reimbursement | Flexible PTO | Learning and development allowance | Medical, dental & vision coverage | Reimbursement for adoption and parental planning servicesSenior-level Full TimeDenver, Colorado, United States; San Francisco, …13h ago
-
Machine Learning Engineer, Agentic Systems - Moveworks USD 116K-192KAsyncio | Backpressure | Distributed locking | Distributed tracing | DynamoDBFlexible work location | Remote flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States13h ago
-
Senior Data Engineer USD 190K-224KAWS | Airflow | CDC Pipelines | Change Data Capture | Cloud Data401k matching | Cellphone stipend | Commuter benefits | Family planning benefits | Flexible PTOSenior-level Full TimeRemote U.S. R14h ago
-
Lead Software Engineer - Generative AI USD 175K-219KAgile | Algorithms | Data Pipelines | Data Structures | Deep learningSenior-level Full TimeRedwood City, California, United States14h ago
-
Senior Software Engineer - Generative AI USD 150K-198KAlgorithms | Data Structures | Deep learning | Distributed Computing | Fine TuningSenior-level Full TimeRedwood City, California, United States14h ago
-
Senior Software Engineer, Perception USD 162K-260KC++ | Camera systems | Cloud processing | Computer Vision | Deep learningAnnual bonus | Benefits | Equity compensation | Hybrid work environmentSenior-level Full TimeMountain View, California14h ago
-
AWS CUR | Airflow | Amazon Glue | Amazon Web Services | Azure Cost Management401k match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceSenior-level Full TimeLos Angeles, USA14h ago
-
Senior Staff Machine Learning Engineer, Trust USD 244K-305KA/B | A/B Testing | API Design | Agentic AI | Anomaly DetectionEmployee travel credits | Inclusion and belonging support | Remote work eligibleSenior-level Full TimeRemote - USA R14h ago
-
Chile Based, Machine Learning Engineer USD 145K-195KCloud Computing | Computer Vision | Dataset curation | Deep learning | Edge Computing401k matching | Daily team lunches | Disability insurance | Equity package | Health coverage allowanceSenior-level Full TimeDenver, Colorado15h ago
-
Agentic AI Engineer USD 130K-170KAWS | AWS IAM | AWS Lambda | Agent Orchestration | Amazon Bedrock401k plan | Autonomous work | Discretionary time off | Fertility benefit | Flexible work arrangementMid-level Full TimeSalt Lake City, Utah15h ago
-
Agentic AI Engineer USD 130K-170KAWS Identity | AWS Identity and Access Management | AWS Lambda | Access Management | Agent Orchestration401k plan access to crypto | Autonomous work | Discretionary time off | Fertility benefit | Flexible work arrangementsMid-level Full TimeSeattle, Washington15h ago
-
Associate Software Engineer – Java (AI First) USD 140K-200KAPI Design | Async Programming | CI/CD | CompletableFuture | ConcurrencyCareer development | Distributed team collaboration | Learning opportunities | Work from anywhereMid-level Full TimeCanada R16h ago
-
Associate Software Engineer – Java (AI First) USD 140K-200KAPI Design | Async Services | CI/CD | CompletableFuture | Concurrent programmingWork from anywhereMid-level Full TimeUnited States R16h ago
-
AI Transformation Lead USD 115K-130KAI Governance | AI Testing | Agentic Frameworks | Amazon Bedrock | Artificial Intelligence401k | Dental insurance | Flexible PTO | Growth opportunities | Medical insuranceSenior-level Full TimeAustin, TX16h ago
-
Sr. Software Engineer (Data Science/Data Engineering) USD 160K-225KAngular | C Sharp | CI/CD | Calculus | Continuous integrationExtended hours | Travel When Needed | Weekend workSenior-level Full TimeBastrop, TX16h ago
-
AI | Azure Data | Azure Data Explorer | Azure DevOps | C#Cross-functional collaboration | Hybrid work environmentSenior-level Full TimeRedmond, WA16h ago
-
Senior Machine Learning Engineer, Insights USD 150K-210KAPIs | AWS | Batch Processing | CI/CD | DebuggingOn-call rotationsSenior-level Full TimeBoston, MA16h ago