Data Engineer
Tasks
- Design build and maintain ELT ETL pipelines into Databricks
- Develop and maintain reverse ETL pipelines
- Implement schema management and data normalization
- Optimize ETL performance data storage and job execution costs
- Process change data capture incremental loads
- Transform raw data into structured governed datasets
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Change Data Capture | Data Capture | Data Modeling | Data Normalization | Data Quality | Databricks | ELT | ETL | GitHub | Incremental loading | Medallion Architecture | PySpark | Python | SQL | Schema management | Scrum | Unit Testing | Version control
Education
N/A
Roles
Related jobs
-
Staff Machine Learning Engineer 2, Ads USD 159K-309KAWS | Airflow | Apache Spark | BigQuery | Cloud Platforms401k plan company match | Disability insurance | Electric Car Charging Station | Employee assistance program | Flexible spending accountSenior-level Full TimeMountain View, USA6h ago
-
Staff Machine Learning Engineer 2, Ads USD 164K-282KAWS | Airflow | Amazon SageMaker | Apache Spark | BigQuery401k plan with company match | Dental insurance | Disability insurance | Electric car charging | Employee assistance programSenior-level Full TimeMountain View, USA6h ago
-
Lead Software Engineer - Data Platform USD 150K-175KAPIs | AWS | CI/CD | Data Governance | Data Modeling401k match | Company holidays | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeUnited States R10h ago
-
Revenue AI Solutions Analyst USD 140K-216KAI integration | CRM | Data platforms | ERP | LLM Agents401k | Employee assistance program | Medical, dental, and vision insurance | Paid sick leave | Paid vacationSenior-level Full TimeMilpitas, CA, United States10h ago
-
Data Analytics - Associate USD 110K-150KA/B | A/B Testing | B testing | DBT | Data ModelingEmployer-Matched Retirement Plan | Paid dental vision telemedicine | Parental leave | Remote work Friday flexibility | Subsidized healthcareSenior-level Full TimeNew York, New York, United States R11h ago
-
Senior Software Engineer, AI Solutions USD 120K-142KAI Agents | API Integration | AWS Bedrock | Airflow | Amazon SageMakerDental insurance | Dependent Care Account | Employer match | Flexible spending account | Health insuranceSenior-level Full TimeNew York, NY, United States13h ago
-
Senior Data Engineer USD 120K-142KAPIs | Apache Airflow | DBT | Data Governance | Data Modeling401b retirement savings program | Employer match | Flexible spending accounts | Health, dental, vision insurance | Mental health counseling supportSenior-level Full TimeNew York, NY, United States13h ago
-
AWS | Agile | Airflow | Alteryx | AzureSenior-level Contract Full TimeChicago, Illinois, United States14h ago
-
Senior AI Engineer USD 120K-180KAPI Integration | Agent Orchestration | Agent systems | Autogen | Compliance checks401k match | Career growth | Dental insurance | Employee resource groups | Health insuranceSenior-level Full TimeRemote, United States R14h ago
-
Data Visualization Engineer USD 130K-140KAWS | Agile | Amazon QuickSight | Azure | DAXPublic trust clearance support | Remote workMid-level Full TimeWork from home, VA, United States R14h ago
-
Senior Cloud Database Engineer USD 144K-180KAWS | AWS Step Functions | Amazon Aurora | CI/CD | Database AdministrationFinancial coaching | Flexible time off | Free therapy sessions | Legal advice | Parental leaveSenior-level Full TimeRemote, USA R15h ago
-
Senior Machine Learning Engineer USD 135K-170KData Visualization | Deep learning | Experimental Design | Generative AI | Language Processing401k match | Company holidays | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeUnited States R15h ago
-
Staff Data Engineer, Analytics USD 248K-279KAlerting | Anomaly Detection | BI reporting | BigQuery | CI/CDSenior-level Full TimeSan Francisco Bay Area15h ago
-
Artificial Intelligence Engineer - Associate USD 100K-140KAWS | Artificial Intelligence | CI/CD | Data Analysis | Dataset versioningEmployer-Matched Retirement Plan | Parental leave | Remote work flexibility | Subsidized healthcare | TelemedicineMid-level Full TimeGreenwich, Connecticut, United States; New York, … R16h ago
-
Robotic Software Engineer (Drone Stack) USD 135K-175KAgile | Agile Development | ArduPilot | Autopilot | BashOccasional remote work | On-site flexibility | Paid time off | Travel for integration and demonstrationsMid-level Full TimeWashington, District of Columbia, United States17h ago
-
Customer Analytics | Customer decisioning | Data Engineering | Data Modeling | Data Standardization401k | Accident insurance | Dental insurance | Disability insurance | Health insuranceSenior-level ContractVienna, United States17h ago
-
Senior Machine Learning Engineer USD 146K-180KAWS | AWS Lambda | Agile | Amazon Athena | Amazon BedrockMentorship | Onboarding support | Remote workSenior-level Full TimeUnited States18h ago
-
Apache Iceberg | Apache OpenLineage | Apache Spark | Columnar file formats | DuckDBSenior-level Full TimeNew York, New York, USA18h ago
-
Senior Insurance Data Science Consultant USD 180K-204KActuarial modeling | Data Validation | Decisioning Platforms | Insurance analytics | Machine LearningSenior-level Full TimeBoston, MA, US18h ago
-
AI Architect USD 130K-230KAgentic AI | Amazon Web Services | Azure | Bagging | CI/CDMentorship opportunities | Remote work environmentSenior-level Full TimeUnited States18h ago
-
Data Engineer USD 159K-200KAWS DMS | AWS Glue | Amazon ECR | Amazon ECS | Amazon RedshiftFlexible remote weeks around holidays | Generous perks | In-office collaborationSenior-level Full TimePhiladelphia, Pennsylvania, United States18h ago
-
Bill of Materials | Change Management | Data Cleansing | Data Governance | Data Management401k | Collaborative team environment | Cross training | Dental insurance | Medical insuranceMid-level Full TimeWichita, KS, United States19h ago
-
Agios AI Foundation Software Engineer USD 165K-261KAgent Frameworks | Audio Processing | Autogen | Bias Mitigation | Computer VisionSenior-level Full TimeRedmond, WA20h ago
-
Senior Software Engineer, AI/ML, Youtube Ads USD 174K-252KData Processing | Data Storage | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA20h ago
-
C++ | CSS | Database Development | HTML | HTTPMid-level Full TimeAnn Arbor, MI, USA20h ago