Data Engineer - AI (Spark, Databricks and Healthcare)
Tasks
- Build data pipelines
- Complete tasks using ticketing system
- Create SQL scripts for data management
- Create Spark scripts for data management
- Ensure data integrity compliance
- Maintain SQL scripts for data validation
- Maintain Spark scripts for data validation
- Optimize queries for efficiency
- Perform data analysis and identify issues
- Support after hours or weekends as needed
- Track individual productivity
- Troubleshoot environmental and network issues
- Validate results against requirements
Perks/Benefits
- 401k savings plan
- Dental insurance
- Disability insurance
- Flexible work schedule
- Health insurance
- Life insurance
- Paid Holidays
- Paid family leave
- Paid time off
- Remote work
- Vision insurance
Skills/Tech-stack
AWS S3 | Airflow | Amazon Web Services | Apache Spark | Cloud platform | Databricks | Databricks Workflows | Google Cloud | Google Cloud Platform | Hadoop | Jira | Kafka | Microsoft Azure | Microsoft SQL | Microsoft SQL Server | Oracle | PL/SQL | SQL | SQL Server | Snowflake | Web Services
Education
Roles
Related jobs
-
Data Engineer Senior Principal (Hybrid) USD 144K-195KAmazon S3 | Amazon Web Services | Amazon Web Services (AWS) | Apache Airflow | Apache Flink401k match | Health insurance | Hybrid work | Paid time offSenior-level Full TimeUSA NC Fort Bragg - 2929 … R16h ago
-
Senior Analytics Engineer USD 158K-220KAutomation | CI/CD | Code review | DBT | Data LineageBetterUp coaching | Charitable contribution 401k self contribution | Company holidays | Development plan | Flexible paid time offSenior-level Full TimeUnited States (Hybrid) R17h ago
-
AWS | AWS CDK | AWS Glue | Airflow | Athena401k | Health insurance | PTO | Paid Company Holidays | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R17h ago
-
Senior Data Engineer - AI USD 147K-198KAmazon Kinesis | Amazon Redshift | Apache Airflow | Apache Flink | Apache IcebergHybrid work model | Onsite two days per weekSenior-level Full TimePennsylvania-Remote, United States R18h ago
-
Data Science Engineer USD 130K-160KA/B | A/B Testing | B testing | Data pipeline | Deep learning401k matching | Company housing for 90 days | Company technology package | Dental insurance | Flexible vacationSenior-level Full TimeSan Francisco R19h ago
-
Senior Data Engineer – Data Proposition Products USD 140K-170KDBT | Data Governance | Data Lineage | Data Modeling | Data QualityDiscretionary bonus | Employee benefits package | Hybrid work schedule | Promote from within | Training opportunitiesSenior-level Full TimeDenver, Colorado, United States; New York, … R19h ago
-
Staff, Analytics Engineer USD 155K-228KCI/CD | Cause analysis | DBT | Data Modeling | Data ObservabilityHealthcare | Paid parental leave | Paid personal time off | Paid sick time | Paid time offSenior-level Full TimeRemote - US R19h ago
-
AI Solutions Engineer USD 106K-171KAPIs | Alteryx | Analytics | Automation | Content GenerationDiscretionary paid time off | Emotional & mental wellness support | Employee resource groups | Fitness programs | Learning and development programsMid-level Full TimeScottsdale, Arizona, United States R20h ago
-
Lead, Finance Analytics & Enablement AI/ML USD 140K-225KAmplitude | Automation | Business Intelligence | Cloud platform | Data Governance401k plan | Co-working access | Disability insurance | Employer paid dental | Employer paid visionSenior-level Full TimeBoston - Remote R20h ago
-
Lead, Finance Analytics & Enablement AI/ML USD 400K-500KAmplitude | Automation | Business Intelligence | Cloud platform | Data Engineering401k plan | Co-working space access | Disability insurance | Flex Spending Account | Health reimbursement accountSenior-level Full TimeNew York - Remote R20h ago
-
Senior AI/ML Engineer USD 125K-156KAWS | Access Control | Agent Orchestration | Apache Spark | CI/CD401k | Commuter benefits | Disability insurance | Employee referral program | Fertility care benefitsSenior-level Full TimeUS Remote R20h ago
-
Principal Data Engineer - AI USD 147K-198KAmazon Kinesis | Amazon Redshift | Apache Airflow | Apache Flink | Apache IcebergHybrid work onsite two days per weekSenior-level Full TimePennsylvania-Remote, United States R20h ago
-
Data Engineer USD 74K-133KAgile | Apache Airflow | Cloud Composer | Cloud Data | Cloud Dataflow401k retirement program | Annual incentive program | Dental insurance | Disability insurance | Flexible time offMid-level Full TimeLisle, IL, United States R22h ago
-
Staff Machine Learning Engineer USD 119K-196KAsync Python | BigQuery | CI/CD | Causal Inference | Cloud RunSenior-level Full TimeNew York,US-NY,United States R22h ago
-
AI Engineer USD 180K-240KAgent Orchestration | Async Programming | Embeddings | LLM | Node.jsCoaching | Equity participation program | Family leave plus | Health benefits | Language trainingMid-level Full TimeBoston, Massachusetts, United States (Hybrid) R1d ago
-
Senior Data Engineer USD 135K-165KAWS Kinesis | Access Control | Apache Airflow | Apache Kafka | Audit Logging401k | Health care coverage | Paid time offSenior-level Full TimeVirtual, United States R1d ago
-
AI Solutions Architect USD 135K-221KBias Mitigation | CCPA | Cloud deployment | Data Governance | Deep learningFlexible working arrangements | International team | Personal development plan | Professional development | Remote workSenior-level Full TimeUSA - Hybrid R1d ago
-
IT Data Engineer USD 60K-65KANSI X12 | AWS | Azure | Azure Data | Azure Data Factory401k match | Disability insurance | Employee assistance program | Flexible spending account | Life insuranceMid-level Full TimeUS - Remote R1d ago
-
Oracle Analytics Cloud/ADW Specialist USD 86K-178K800-53 | APIs | Analytics Cloud | Audit | Autonomous Data WarehouseCollaborative work environment | Dental insurance | Flexible work environment | Health insurance | Paid HolidaysMid-level Full TimeRemote (United States) R1d ago
-
Analytics Engineer USD 125K-215KBusiness Intelligence | DBT | Data Governance | Data Lineage | Data Quality401k savings plan | Commuter benefits | Company-paid health insurance | Equipment stipend | Healthcare FSAMid-level Full TimeNew York City, NY R1d ago
-
Data Engineer USD 100K-140KAWS | Azure | Azure DevOps | CI/CD | Data Governance401k | Generous PTO | Hybrid schedule | Longevity bonuses | Medical/Dental/VisionSenior-level Full TimePlano, TX, United States R1d ago
-
Staff Data Engineer USD 160K-207KAnomaly Detection | Business Intelligence | DBT | Data Architecture | Data Engineering401k match | Dental insurance | Family planning resources | Flexible vacation days | Learning and development programSenior-level Full TimeRemote - USA R1d ago
-
API Integration | API Security | Authentication | CI/CD | Cloud NetworkingAnnual performance bonus | Career growth | Fully remote workSenior-level Full TimeCanada R1d ago
-
Senior AI Software Engineer USD 98K-153KAsynchronous processing | CI/CD | Docker | Embeddings | Generative AIMonthly Connectivity reimbursement | Work from home optionSenior-level Full TimeUSA - IL (Remote), United States R1d ago
-
Associate Director, AI Engineer - Remote USD 176K-327KArtificial Intelligence | Cloud Platforms | Data Governance | Data Quality | Data VisualizationMid-level Full TimeRemote Position (USA), United States R1d ago