Senior Data Engineer
Tasks
- Automate data pipelines with metadata and data quality checks
- Build and support cloud big data platform
- Build data ingestion data integration and curation
- Capture and publish metadata
- Collaborate with analysts data scientists and business stakeholders
- Conduct design and code reviews
- Create reusable data ingestion integration and provisioning framework
- Define job automation and testing
- Design data pipelines
- Improve reporting and analysis workflows
- Mentor and coach engineers
- Optimize pipelines for machine learning workloads
- Support near real time data needs
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | C# | DBT | Data Lake | Data Quality | Data Warehouse | Databricks | Flink | Hadoop | Java | Kafka | Machine Learning | Metadata Management | Nifi | Python | Real Time | Real-time Processing | SQL | Scala | Schema Design | Spark | Streaming | Time processing
Education
Roles
Related jobs
-
Langchain | Language Models | Large Language Models | MLOps | Machine LearningFreelance project based engagement | Part-time project workMid-level FreelanceNew York, United States - Remote R12h ago
-
Big Data | Feature Engineering | Langchain | MLOps | Machine LearningFreelance work | Part-time projects | Project based workMid-level FreelanceUnited States - Remote R12h ago
-
LLM | Langchain | MLOps | Machine Learning | MatplotlibEnglish proficiency assessment | Flexible hours | Part-time project work | Project-based employmentMid-level FreelanceTexas, United States - Remote R12h ago
-
Generative AI | Langchain | Language Models | Large Language Models | MLOpsPart-time project-based workMid-level FreelanceUnited States - Remote R12h ago
-
LLM | Langchain | MLOps | NumPy | PandasPart-time availability | Project based workMid-level FreelanceNew York, United States - Remote R12h ago
-
Sr. Analytics Engineer USD 145KAWS | Azure | Business Intelligence | Data analytics | DatabricksEmployee assistance program | Group term life insurance | Home-office allowance | Internet reimbursement | Long-term disabilitySenior-level Full TimeUnited States - Remote R12h ago
-
Senior Data Scientist II (ML) USD 182K-266KAWS | Apache Spark | Cloud Computing | Data labeling | Dataset curationDental & vision coverage | Disability plans | Flexible spending account | Flexible vacation policy | Health savings accountMid-level Full TimeRemote, USA R12h ago
-
Principal Machine Learning Engineer USD 220K-300KCUDA | Continuous Learning | Data Preparation | Drift monitoring | Embedding401k | Employee assistance program | Employee stock purchase plan | Health savings account | Medical/Dental/Vision insuranceSenior-level Full TimeUnited States | Remote R12h ago
-
Embedded Software Engineer III/IV - Remote USD 150K-200KC# | C++ | CAN bus | Configuration Control | Embedded firmware401k match | Company holidays | Dental insurance | Life insurance | Medical insuranceSenior-level Full TimeSan Luis Obispo, California R12h ago
-
APIs | Agent Orchestration | Agentic Systems | Air-gapped | Air-gapped environments401k option | Comprehensive health care | Equity Incentives Option | FSA option | Mental health benefitsSenior-level Full TimeSeattle, WA or McLean, VA or … R14h ago
-
Staff Data Engineer USD 190K-212KAmazon Kinesis | Apache Flink | Apache Kafka | Apache Spark | Business IntelligenceSenior-level Full TimeRemote-United States R14h ago
-
Senior Data Platform & Healthcare AI Analytics Engineer USD 150K-190KAI Services | API Management | Access Control | Azure AI | Azure AI Services401k match | Flexible spending account | Life insurance | Long-term disability | Medical/Dental/VisionSenior-level Full TimeRemote (United States); Nashville, TN R18h ago
-
Software Engineer, Data USD 130K-176KDBT | Data Quality | Data Validation | Databricks | ETLLearning and development | Remote work optionEntry-level Full TimeRemote - United States R18h ago
-
Senior Software Engineer, Data USD 156K-211KDBT | Databricks | ETL | PySpark | PythonCollaborative supportive team | Learning and mentoring culture | Mission-driven work | Remote work flexibilitySenior-level Full TimeRemote - United States R18h ago
-
Lead Software Engineer, Combinatorial Optimization USD 155K-213KAI Planning | C++ | CI/CD | Combinatorial Optimization | Constraint ProgrammingCompany holidays | Health insurance | Learning and development reimbursement | Life insurance | Long-term disabilitySenior-level Full TimeTorrance, California, United States; US - … R19h ago
-
Jr. AI Engineer USD 70K-85KAPI Development | Backend Development | Database Design | Embeddings | Generative AI401k matching | Bonuses | Cell phone reimbursement | Dental insurance | Health insuranceEntry-level Full TimeNew York, NY; Remote/Hybrid R19h ago
-
Data Engineer II USD 75K-112KAPI | Automated testing | Data Modeling | Data Pipelines | Data Validation401k employer match | Commuter benefits | Fitness reimbursement | Fun team events | International travel opportunitiesMid-level Full TimeAtlanta, Boston, Remote US R21h ago
-
Senior Data Engineer USD 100K-136KAWS | Aerospike | BigQuery | Bigtable | Buildkite401k match | Corporate discounts | Dental insurance | Education assistance | Flexible work optionsSenior-level Full TimeGreensboro, NC, United States R22h ago
-
Senior Data Engineer USD 104K-164KBatch Processing | Cloud Computing | Data Catalog | Data Governance | Data ModelingBirthday time off | Country specific holidays | Employee Referral Bonus Program | Home office stipend | Medical, dental & vision coverageSenior-level Full TimeRemote US R22h ago
-
AWS | Azure | Cloud Computing | Cloud platform | Distributed SystemsAnnual leave policy | Bonus | Equity | On-call rotation | Remote workSenior-level Full TimeUnited States (Remote) R23h ago
-
Artificial Intelligence | Computer Vision | Data labeling | Dataset Management | Edge ComputingDental insurance | Equity | Gym reimbursement | Medical insurance | Paid premiumsSenior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Engineer- AI USD 136K-225KAWS | Agentic AI | As-a-Service | Autogen | Cause analysis401k employer match | Comprehensive medical, dental, and vision | Paid parental leave | Paid time offMid-level Full TimeBoston, United States R1d ago
-
Principal Software Engineer- AI USD 174K-287KAWS | Embeddings | Generative AI | Hugging Face | KerasEmployee assistance program | Health insurance medical dental and vision | Paid parental leave | Paid time off and holidays | Retirement 401k Employer MatchSenior-level Full TimeBoston, United States R1d ago
-
Data Platform Integration Engineer (Senior Associate) USD 120K-194KAPI Gateway | APIs | AWS | AWS CDK | Apache AirflowHybrid work option | Remote-first work environment | Travel up to 10 percent per yearSenior-level Full TimeChicago - 550 Van Buren, United … R1d ago
-
Senior Software Engineer USD 144K-192KAngular | Apache Spark | Buildah | Docker | Fine TuningContinued career development programs | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer timeSenior-level Full TimeUS-California-Remote, United States R1d ago