Data Engineer (P-175)
Tasks
- Apply software engineering best practices
- Build data ingestion solutions
- Build data pipelines
- Build data transformation solutions
- Collaborate with data stakeholders
- Design data pipelines
- Develop data workflows
- Document pipeline architecture
- Improve data quality
- Integrate data across systems
- Maintain data pipelines
- Monitor data pipelines
- Optimize pipeline performance
- Optimize pipeline scalability
- Process large-scale datasets
- Troubleshoot data pipelines
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | CI/CD | Data Quality | Data Validation | Data integration | ELT | ETL | Microsoft Azure | PySpark | Python | SQL | Spark SQL | Testing | Version control
Education
N/A
Roles
Related jobs
-
AI/ML Solutions Engineer USD 139K-200KAI Explainability | AWS Glue | AWS SageMaker | AWS Step Functions | Amazon AthenaMid-level Full TimeMiami Lakes, FL, United States13h ago
-
Principal Machine Learning Engineer USD 240K-420KAgent systems | Architecture | C plus plus | Compliance | Deep learning401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R14h ago
-
Senior Data Engineer USD 109K-164KAI Services | Azure AI | Azure AI Services | Azure Data | Azure Data Factory401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeAustin, Texas, USA R17h ago
-
Mid-level Full Time10 Park Plaza, Boston20h ago
-
Senior-level Full TimeRemote, Canada; Computer/Software; Canada, Canada; Remote, … R21h ago
-
ANSI SQL | Amazon Redshift | Analytical modeling | Cloud Data | Cloud Data PlatformsCareer growth | Onsite work | Possible contract extension | Successful Completion Bonus | Support from consultantsMid-level Full TimeJuno Beach, FL; Juno Beach, FL; …21h ago
-
AWS | Bitbucket | Confluence | Data Analysis | Eclipse401k employer contribution | Direct contribution to 401k vesting | Educational assistance | Federal Holidays | Healthcare benefitsSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland; …21h ago
-
Software Engineer 1 - (Python, UI/UX, LLM) USD 169K-207KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Healthcare coverage | PTOMid-level Full TimeAnnapolis Junction, Maryland21h ago
-
Senior Applied AI Engineer 3 - (Python, LLMs, RAG) USD 241K-295KAI Agents | APIs | Backend Development | Data Pipelines | Docker401k matching | Education assistance | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland21h ago
-
Cloud Software Engineer 3 - (Cloud, Hadoop, Java) USD 228K-278KAnsible | Apache Kafka | Apache Lucene | Apache Solr | Avro401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeFort Meade, Maryland R21h ago
-
Part Time Student - Robotics Engineer - Ames, IA USD 30K-80KArduino | C plus plus | Computer Vision | Data Analysis | JavaAdoption Assistance | Employee assistance programs | Fitness subsidies | Flexible work arrangements | Healthcare benefitsEntry-level Part TimeAmes, IA,Iowa,United States22h ago
-
C# | C++ | Control Systems | Data Management | Machine Learning401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceMid-level Full TimeGroton, CT, United States23h ago
-
Senior Data Engineer USD 130K-150KAWS | Amazon S3 | Apache Airflow | Apache Hadoop | Apache Kafka401k | Employee assistance | Life insurance | Medical, dental & vision coverage | Paid time offSenior-level Full TimeSan Antonio, TX, United States1d ago
-
Software Engineer III, AI/ML, Platforms and Devices USD 147K-210KAndroid | C++ | Data Processing | Debugging | Language ProcessingSenior-level Full TimeSeattle, WA, USA1d ago
-
AI Strategy Lead USD 192K-278KAgentic AI | Artificial Intelligence | As-a-Service | Business Intelligence | Data AnalysisSenior-level Full TimeChicago, IL, USA; Sunnyvale, CA, USA1d ago
-
Agents | Artificial Intelligence | Automated Evaluation | C++ | Code reviewSenior-level Full TimeSunnyvale, CA, USA1d ago
-
API Development | Artificial Intelligence | C# | C++ | Computer VisionMid-level Full TimeSunnyvale, CA, USA; Atlanta, GA, USA1d ago
-
Staff ML Engineer, Search Ads Shopping Relevance Models USD 207K-300KC++ | CI/CD | Data Analysis | Data Processing | Deep learningSenior-level Full TimeMountain View, CA, USA1d ago
-
Software Engineer, ML Accelerators, DeepMind USD 174K-252KC++ | Hardware Accelerators | JAX | Kernel development | Machine LearningMid-level Full TimeMountain View, CA, USA; San Francisco, …1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Flexible management approach | Professional growth opportunities | Remote or distributed workMid-level Full TimePalo Alto, CA, USA1d ago
-
Bash | Cloud infrastructure | Data Ingestion | Data Ingestion Pipelines | Data ProcessingAsynchronous culture | Career growth | Impactful mission | Remote-friendly cultureMid-level Full TimeLos Angeles, CA, USA1d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Remote workMid-level Full TimeBellevue, WA, USA1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Equity | Remote-friendlyMid-level Full TimeDenver, CO, USA1d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Friendly laid-back atmosphere | Opportunity for career growthMid-level Full TimeAnaheim, CA, USA1d ago
-
Bash | Data Ingestion | Data Ingestion Pipelines | Data Processing | DockerAsynchronous culture | Flexible management approach | Mission driven product impact | Supportive team environmentMid-level Full TimeProvo, UT, USA1d ago