Senior Data Engineer
Tasks
- Align data solutions with business needs
- Build APIs and file upload mechanisms for client data ingestion
- Design and implement scalable data ingestion pipelines
- Develop data mapping and transformation workflows
- Document architecture workflows and operational procedures
- Enable data flow from SaaS to analytical platform
- Ensure data availability and quality for reporting and machine learning
- Implement data governance, security, and compliance best practices
- Implement data lakehouse architecture with Databricks
- Optimize ETL and ELT processes
- Provide operational support for ingestion processes
- Troubleshoot and resolve data pipeline issues
Perks/Benefits
- 401k match
- Dental insurance
- Education assistance program
- Employee assistance program
- Family leave
- Hybrid work
- Life insurance
- Medical insurance
- Paid time off
- Remote eligible
- Vision insurance
- Wellness reimbursement
Skills/Tech-stack
API Development | API Gateway | AWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Amazon API | Amazon API Gateway | Apache Spark | Azure DevOps | C Sharp | C Sharp Net | Cloud Compliance | Data Governance | Data Lakehouse | Data Modeling | Data Security | Data pipeline | Data pipeline troubleshooting | Databricks | ELT | ETL | File ingestion | Multi-tenant | Multi-tenant architecture | Pipeline troubleshooting | Python | SQL Server | Step Functions | Tenant architecture
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Information Technology
Roles
Related jobs
-
Senior-level Full TimeMansfield, MA (Remote) R15h ago
-
Staff Software Engineer, Applied AI USD 200K-240KDataset curation | Evaluation | FastAPI | LLM | Langchain401k | Co-working space reimbursement | Equity incentive | Flexible vacation policy | HSA contributionSenior-level Full TimeU.S. (Remote) R16h ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | On call production supportMid-level Full TimeOrlando, FL, United States R20h ago
-
Cleared Hybrid Data Engineer (5418) USD 103K-171KAPI Integration | AWS | AWS Glue | AWS Redshift | Access ControlHealth insurance | Learning and development opportunities | Paid leave | RetirementSenior-level Full TimeHanover, MD R20h ago
-
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS CloudWatch401k plan | Healthcare benefits | PTO | Paid Company Holidays | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R21h ago
-
Autonomy | C++ | DDS | Data Ingestion | Debugging401k | Healthcare coverage | PTO | Paid Holidays | Phone stipendMid-level Full TimeSan Carlos - Hybrid R21h ago
-
Autonomy | C++ | CPU GPU | CPU/GPU Optimization | DDS401k | Healthcare | Hybrid work | Paid Holidays | Paid time offSenior-level Full TimeSan Carlos - Hybrid R21h ago
-
Senior DataOps Engineer USD 130K-258KAgent Jobs | App Service | App Service Environments | App Services | Azure AutomationSenior-level Full TimeRemote R22h ago
-
Apache Airflow | BigQuery | Cloud Dataflow | Cloud platform | DBTAnnual company off site events | Annual professional development budget | Co-working space allowance | Comprehensive health insurance | Equity via ESOPSenior-level Full TimeCanada R22h ago
-
Senior-level Full TimeChicago, Illinois, USA R1d ago
-
Staff Designated Support Engineer USD 122K-160KAWS | AWS Glue | As-a-Service | Azure | Azure DataOn-call support availabilitySenior-level Full TimeUS-TX-Remote R1d ago
-
AI Solutions Engineer - Professional Services USD 107K-144KAPI Integration | Anthropic Claude | Benefit Analysis | Change Management | Code MigrationRemote work | Work from anywhereMid-level Full TimeUnited States R1d ago
-
Director, Data Science: Data Science Tools USD 125K-211KAirflow | Bash | Celery | Dash | DatabricksHybrid schedule | Professional development | Remote workExecutive-level Full TimeRemote, Remote, United States R1d ago
-
Software Engineer, ML Dev Enablement USD 123K-163KAWS | C++ | DDP | Data Pipelines | Distributed Systems401k match | Dental insurance | Health insurance | Health savings account | Hybrid remote workSenior-level Full TimeLas Vegas, Nevada, United States; Remote … R1d ago
-
Senior Software Engineer- Big Data & Java USD 133K-160KADLS | AWS | Amazon S3 | Apache Beam | Apache FlinkAllyship and inclusion communities | Caregiver leave | Continuous development support program | Employee assistance program | Employee recognitionSenior-level Full TimeRemote, USA R1d ago
-
Senior Staff AI Data Engineer - Hybrid USD 135K-202KAWS | Alerting | Azure | Batch pipelines | ChunkingHybrid work schedule | Learning and development opportunities | MentorshipSenior-level Full TimeHartford CT- Home Office, United States R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
AI Engineer - Application Development USD 75K-158KAPI Integration | AWS | Agno | Amazon Bedrock | AzureFlexible time off | Learning resourcesMid-level Full Time999 REMOTE, United States R1d ago
-
Embedded AI Engineer USD 100K-150KC++ | Core ML | Edge AI | Edge inference | Energy EfficiencyCareer growthSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Edge AI Engineer USD 100K-150KC++ | Core ML | Energy Efficiency | Federated Learning | Hybrid Cloud100 percent remote | Diversity and inclusion | Long-term career growthSenior-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Computer Vision | Data Quality | Data labeling100 percent remote work | Benefits packageMid-level Full TimeUnited States - Remote R1d ago
-
AI Research Engineer USD 100K-150KAblation Studies | Accelerators | Baseline Models | Computer Vision | Data QualityFull-time benefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago