Data Engineer
Tasks
- Automate Databricks asset deployments
- Build real time and regulatory reporting pipelines
- Configure fine grained access controls
- Design lakehouse data pipelines
- Develop orchestrated data workflows
- Implement data governance and security controls
- Implement streaming data ingestion
- Integrate Databricks with AWS Glue
- Integrate Databricks with Amazon S3
- Integrate secure access with AWS IAM
- Maintain data lineage and auditing
- Manage AWS compute costs
- Optimize Delta Lake storage
- Optimize Spark clusters performance
Perks/Benefits
Skills/Tech-stack
AWS CodePipeline | AWS Glue | AWS IAM | Amazon S3 | Amazon Web Services | Apache Spark | Asset bundles | CI/CD | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Jobs | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | GitHub Actions | GitLab CI | GitLab CI/CD | Kafka | PySpark | Python | SQL | Streaming Data | Terraform | Unity Catalog | Web Services
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Agile | Angular | Azure DevOps | CSS | Cloud DataHybrid RemoteMid-level Full TimeTampa R3h ago
-
AWS Glue | Amazon RDS | Amazon Redshift | Amazon S3 | Artificial Intelligence401k matching | Certification programs | Disability insurance | Employee resource groups | Fertility coverageEntry-level Full TimeRichmond, VA, United States R5h ago
-
Senior Full Stack & AI Engineer USD 100K-135K.NET | AI Foundry | Agile | Angular | Azure AIContinuous learning | Flexible schedule | Hybrid work modelSenior-level Full TimeMadrid, MD, Spain R7h ago
-
Senior MLOps Engineer USD 165K-250KAI Pipelines | AI endpoints | API Development | Audit Logs | AutoscalingContinuous learning opportunities | Flexible working arrangements | Health equity mission impact | Remote or hybrid optionsSenior-level Full TimeUnited States - Remote R1d ago
-
Data Engineer (2258) USD 119K-150KAWS | Azure | Data Quality | Data Security | Data Visualization401k | Dependent care | Discounted tickets | Entertainment Perks Programs | Flexible work schedulesMid-level Full TimeNew York, New York, United States R1d ago
-
Senior Quantum Software Engineer, Compiler [410] USD 125K-187KC# | C++ | CI/CD | CUDA-Q | CirqBenefits | Mentorship | Team collaborationSenior-level Full TimeHybrid (New Haven, CT, US) R1d ago
-
Staff AI Engineer USD 176K-298KAgentic Workflows | Chroma | Cost Optimization | Embeddings | Evaluation401k plan | Flexible vacation policy | Medical, dental, and vision coverage | Paid Holidays | Parental leaveSenior-level Full TimeRemote - US R1d ago
-
AWS | Azure | CI/CD | Deep learning | Evaluation methodology401k | Equity options | Health, dental, and vision | Relocation package | Sign-on bonusSenior-level Full TimeSan Francisco R1d ago
-
Cloud and Storage Engineer USD 100K-166KAmazon Web Services | Auditing | Backup and Recovery | Capacity Planning | Data DomainComprehensive benefits packageSenior-level Full TimeMiami, FL R1d ago
-
Cloud and Storage Engineer USD 100K-166KAmazon Web Services | As-a-Service | Auditing | Backup and Recovery | Capacity PlanningComprehensive benefits package | Professional growth opportunitiesSenior-level Full TimeAtlanta, GA R1d ago
-
C# | C++ | CUDA-Q | Circuit Emulation | Circuit compilationFlexible work-life balance | Health and wellbeing benefits | Hybrid work schedule | Inclusive workplace culture | Professional development programsSenior-level Full TimeMilpitas, California, United States of America R1d ago
-
API Design | C# | C++ | CUDA | Circuit compilationCareer Development Programs | Health and wellbeing benefits | Hybrid work schedule | Inclusive workplaceSenior-level Full TimeMilpitas, California, United States of America R1d ago
-
AC DC Sizing | AC/DC | Arc Flash | Artificial Intelligence | AutomationMultiple project extensions | Paid on time | Remote work optionSenior-level Full TimeJuno Beach, FL R2d ago
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R2d ago
-
Benchmarking | C plus plus | CUDA | Computational Engineering | Distributed Computing401k match | Generous paid time off | Medical, dental & vision coverage | Stock options | WFH Hardware ReimbursementSenior-level Full TimeSunnyvale, CA R2d ago
-
API Gateway | AWS Lambda | AWS Step Functions | Amazon SQS | Apache Airflow401k matching | Employee stock options | Health benefits | Hybrid work onsite 2 to 3 days per week | Paid time offExecutive-level Full TimeNew York, United States R2d ago
-
Senior Machine Learning Engineer USD 160K-200KAWS | CI/CD | Computer Vision | Data Processing | DockerCommuter benefits | Dental insurance | Employee assistance program | Equity | Health insuranceSenior-level Full TimeArlington, VA R2d ago
-
Senior Computer Vision & Machine Learning Engineer USD 140K-206KAblation Studies | CI/CD | Data Pipelines | Docker | Error AnalysisAutonomy | Client project impact | Support for professional growthSenior-level Full TimeRemote, US R2d ago
-
Computer Vision & Machine Learning Engineer USD 150K-200KAblation Studies | CI/CD | Computer Vision | Data Pipelines | DockerEntry-level Full TimeRemote, US R2d ago
-
Staff Data Engineer USD 162K-224KAmazon Managed Workflows for Apache Airflow | Apache Airflow | Apache Druid | Apache Iceberg | CCPA401k employer match | Annual WIN bonus | Flexible vacation | Mental health resources | Paid HolidaysSenior-level Full TimeU.S. Remote R2d ago
-
Sr Staff AI Engineer - Veza USD 190K-334KAgent Orchestration | Algorithms | C++ | Data Structures | Distributed Systems401k plan with match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeMinneapolis, Minnesota, United States R2d ago
-
Senior GTM AI Engineer USD 154K-213KAgent Orchestration | Agent Performance | Agent Performance Monitoring | Anthropic Claude | App Development401k match | Catered lunch | Company events | Desk setup stipend | Flexible spending accountsSenior-level Full TimeOakland, California, United States R2d ago
-
Data Science Engineer USD 121K-154KData Visualization | Documentation | Entity Resolution | Fine Tuning | Git401k | Education reimbursement program | Flexible schedules | Hybrid schedule | Relocation assistanceEntry-level Full TimeLivermore, CA, United States R2d ago
-
Software Engineer, Database Reliability & Performance USD 100K-168KAI tools | Automated testing | C++ | CI/CD | CircleCI401k | Annual professional development budget | Financial planning and legal advice | Flexible time off | Life insuranceMid-level Full TimeRemote US R2d ago
-
Staff Diagnostics and Embedded Cyber Security Engineer USD 150K-283KAUTOSAR | Automotive Ethernet | BLE | C# | C++Employee resource groups | Flexible family care days | Paid parental leave | Paid time off | Subsidized back-up child careSenior-level Full TimePalo Alto, CA, United States R2d ago