AWS / Databricks Cloud Data Engineer
Tasks
- Build data acquisition pipelines
- Collaborate with technical and non-technical stakeholders
- Create technical documentation
- Design scalable data pipelines
- Develop ETL and ELT pipelines
- Ensure data quality and model consistency
- Ingest transform and load datasets
- Monitor data pipeline health
- Optimize query performance
- Translate business requirements into technical specifications
- Troubleshoot pipeline failures
Perks/Benefits
- 401k
- Catered lunches
- Dental plans
- Medical plans
- Onsite fitness center
- Training opportunities
- Vision plans
- Wellness program
Skills/Tech-stack
API Development | AWS | AWS Lambda | Active Directory | Agile | Amazon RDS | Amazon S3 | Azure Active Directory | CI/CD | Dagster | Database | Databricks | Datadog | Dimensional Modeling | Docker | ELT | ETL | Git | Infrastructure as Code | Medallion Architecture | MySQL | Pandas | PostgreSQL | PySpark | Python | Query Optimization | RBAC | REST API | SCD | SQL | Terraform | Test Planning | “as-code”
Education
N/A
Related jobs
-
Manufacturing Test Engineer, Data Center USD 120K-172KBSCAN | Bash | Bring-up | Calibration | Correlation studyMid-level Full TimeAtlanta, GA, USA1h ago
-
AWS S3 | Almabase | Amazon Athena | Azure Data | Azure Data LakeMid-level Full TimeRemote within Texas, TX, US R4h ago
-
ALB | ALB/NLB | AWS | AWS CDK | AWS CloudSenior-level Full TimeDallas, Texas, United States9h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | MATLAB | NumPy | Number theoryFlexible hours | Freelance opportunities | Project based workSenior-level FreelanceNew York, New York, United States … R12h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KCombinatorics | Graph theory | Mathematics | NumPy | Number theoryFreelance opportunity | Part-time project-based workSenior-level FreelanceFlorida, United States - Remote R12h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | Combinatorics | Graph theory | MATLAB | NumPyFlexible hours | Part-time opportunities | Project based workSenior-level FreelanceTexas, United States - Remote R12h ago
-
Statistics & Python Expert - Freelance AI Trainer USD 146K-146KC# | MATLAB | NumPy | Pandas | PythonPart-time availability | Project based workSenior-level FreelanceMichigan, United States - Remote R12h ago
-
API Integration | Agent systems | Asynchronous processing | Chunking | Cost OptimizationCompetitive salary based on experience | High-impact role | Opportunity to scale AI systems | Strong ownershipMid-level Full TimeAustin, Texas, United States - Remote R12h ago
-
Software Engineer I/II, Machine Learning USD 129K-190KAWS | Amazon S3 | Apache Airflow | Apache Arrow | CI/CD401k matching | Flexible spending account | Health insurance | Hybrid work | Life insuranceMid-level Full TimeBoston Office13h ago
-
ML Ops Engineer USD 174K-226KAWS | Cloud infrastructure | Cost Optimization | Data Ingestion | GCPHybrid work schedule | In-office at least 3 days per weekMid-level Full TimeSan Francisco HQ Office R13h ago
-
Machine Learning Engineer - 1 USD 130K-228KCNN | Cross-validation | Data Pipelines | Deep learning | Document processingEquity options | Flexible-hybrid work | Medical, dental & vision coverage | Professional development budget | Team offsitesNone Full TimeHybrid - San Mateo, California R13h ago
-
Senior-level Full TimeSan Jose, CA, United States15h ago
-
Senior Machine Learning Engineer - Cybersecurity USD 80K-200KAnomaly Detection | Behavioral analytics | Cyber Threat | Cyber Threat Detection | CybersecuritySenior-level Full TimeSan Jose, CA, United States15h ago
-
Senior-level Full TimePalo Alto15h ago
-
Lead AI Engineer - AI & Credit Analytics USD 156K-234KAWS | CI/CD | Data Governance | Generative AI | LLMOpsFlexible time off | Flexible work environment | Hybrid work option | Matching 401k | Medical/Dental/Vision insuranceSenior-level Full TimeCosta Mesa, CA, United States R15h ago
-
Senior-level Full TimePalo Alto15h ago
-
Software Engineer AI Data Platform - CoreAI USD 84K-180KAutomated testing | Batching | C# | C++ | CI/CDEntry-level Full TimeRedmond, WA, US15h ago
-
Software Engineer SME (TS/SCI with Poly Required) USD 187K-318KAPI | API Key | Amazon Kinesis | Amazon Web Services | Apache AirflowMid-level Full TimeChantilly, Virginia, United States15h ago
-
Software Engineer SME (TS/SCI with Poly Required) USD 187K-318KAWS | Anaconda | Apache NiFi | Azure | Azure MicroservicesMid-level Full TimeMcLean, Virginia, United States15h ago
-
Mid-level Full TimeOmaha, NE15h ago
-
Software Engineer, Productivity - Model Performance USD 230K-385KBuild Automation | C++ | CI/CD | Debugging | PyTorchSenior-level Full TimeSan Francisco16h ago
-
DevOps Engineer USD 130K-200KAWS | AWS CDK | Ansible | Bash | CloudFormationAD&D insurance | Disability benefits | Employee assistance resources | Healthcare coverage | Learning and development resourcesSenior-level Full TimeMcLean, Virginia, United States16h ago
-
Senior Embedded Firmware Engineer (T4) USD 120K-165KARM Cortex | Agile | Azure DevOps | Bare Metal | C#Disability benefits | Employee assistance programs | Healthcare coverage | Learning and development resources | Life insuranceSenior-level Full TimeIndianapolis, Indiana, United States16h ago
-
AI Software Engineer - Greenwood Village, CO Office USD 80K-120KAI Agents | API | Automation | C# | Computer VisionCollaborative environment | Comprehensive benefits package | Employee ownership | Flexible workplace | Innovative cultureEntry-level Full TimeGreenwood Village, Colorado, United States R16h ago
-
Senior Staff Engineer -- Lead AI Engineer USD 115K-185KAPI | CI/CD | Code review | Data Lakes | Data ModelingSenior-level Full TimeNew York City, New York, United …16h ago