Data Engineer 2
Parsippany, New Jersey, United States of America
R
USD 135K-155K Senior-level Full Time
Tasks
- Analyze large datasets for processing recommendations
- Build large-scale enterprise data pipelines
- Collaborate with Agile teams including developers and testers
- Create automated unit tests
- Debug pipeline issues and implement fixes
- Design and develop data solutions
- Develop and maintain data processing applications
- Evaluate emerging technologies for platform improvements
- Implement AWS big data pipelines
- Implement ETL and ELT jobs
- Lead or support medium complexity system components
- Monitor and optimize pipeline performance in cloud
- Provide peer support and onboarding
- Review functional specifications and validation deliverables
- Support QA with automated acceptance tests
- Write Apache Spark jobs in Scala
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | Agile | Airflow | Apache Spark | ELT | ETL | Hive | PySpark | SQL | Scala | Terraform
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
APIs | AWS ECS | AWS Lambda | AWS S3 | AgentsSenior-level Full TimeOffice Location or Remote - USA R17h ago
-
API Development | AWS | AWS Lambda | Agentic AI | Amazon EC2Senior-level Full TimeOffice Location or Remote - USA R17h ago
-
Lead, Customer Strategy Analytics & Applied AI USD 190K-210KAI workflows | Analytics | Applied AI | DBT | Data ModelingComprehensive health coverage | Equity | Remote-first workplace | Unlimited PTOSenior-level Full TimeRemote - United States R18h ago
-
Forward Deployed AI Product Engineer USD 180K-230KAI Agents | AI guardrails | API Integration | APIs | AWSAutonomy | Career growth opportunities | Casual work environment | Remote-first culture | Travel for client workSenior-level Full TimeUS-Remote R19h ago
-
Airflow | CI/CD | DBT | Databricks | GitQuarterly in person surges | Remote-first workSenior-level Full TimeRemote - USA R20h ago
-
Senior Data Engineer I USD 119K-201KApache Airflow | Dagster | Data Modeling | Data orchestration | ETLHealth insurance | Parental leave | Professional development stipend | Remote work flexibilitySenior-level Full TimeRemote - US R20h ago
-
Lead Software Engineer USD 121K-155KCI/CD | CodeWhisperer | Docker | ETL | GitHub CopilotFlexible hybrid work model | Health and life insurance | Paid time off | Personal and family care leave | Retirement benefitsSenior-level Full TimeJersey City, NJ, United States R20h ago
-
Senior Cloud Engineer USD 140K-204KAWS | AWS CloudFormation | AWS DMS | AWS Glue | AWS Lake FormationFlexible work arrangements | Professional developmentSenior-level Full TimeRemote - United States R21h ago
-
Machine Learning PhD Intern, Economics (Fall) USD 100K-125KApplied Econometrics | Causal Inference | Experimental data | Keras | Observational dataFlexible work location | In-person events | Remote workEntry-level InternshipUnited States - Remote R21h ago
-
Data Engineer USD 120K-160KAWS | Apache Airflow | DBT | Data Warehousing | ELT401k plan | Commuter benefits | Employee Meals Snacks | FSA | Flexible time offSenior-level Full TimeLos Angeles; New York; Remote; San … R22h ago
-
Data Engineer - Data & Analytics USD 150K-205KAWS | Airflow | Amplitude | BigQuery | CI/CD401k match | Dental insurance | Flexible paid time off | Health and wellness stipend | Health insuranceMid-level Full TimeUnited States R22h ago
-
Senior Applied AI Engineer USD 160K-210KAPI Design | AWS | CI/CD | Circuit Breakers | DockerDynamic work environment | Flexible working hoursSenior-level Full TimeUS - Remote, Canada - Remote R1d ago
-
Data Engineer with Python and React - Remote USD 105K-120KAWS | Airflow | Azure | Data Modeling | Data WarehousingRemote workSenior-level Full TimeJersey City, New Jersey, United States R1d ago
-
Senior Data Engineer (Hybrid Eligible*) USD 135K-173KAPI Integration | Access Control | CI/CD | Change Data Capture | Cost Optimization401k plan | Bonus programs | Employee assistance programs | Health insurance | Life and AD D InsuranceSenior-level Full TimeSeattle, WA, United States R1d ago
-
Senior Data Scientist, Machine Learning USD 194K-218KAWS | Active Learning | Airflow | Amazon Redshift | Automated Labeling100% TelecommutingSenior-level Full TimeRedwood City, CA R1d ago
-
Principal Data Engineer USD 141K-166KAWS | Agile | Amazon Web Services | CI/CD | ConfluenceRemote work within United StatesSenior-level Full Time245 Summer St, Boston MA, United … R1d ago
-
Senior-level Full TimeUS - VA - Remote, United … R1d ago
-
AI Engineer USD 66K-145KAWS | Azure | CI/CD | Deep learning | DockerHealth benefits | Home-based work | Paid time off | Retirement contributionsMid-level Full TimeUS - VA - Remote, United … R1d ago
-
Analytics Engineer, AV Safety Engineering USD 160K-250KAccess Management | CI/CD | Cloud Computing | Containerization | Data PipelinesFlexible work location with commute requirement | Remote workSenior-level Full TimeWork From Home - United States, … R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KActive Learning | Apache Beam | Apache Spark | CI/CD | CachingMid-level Full TimeUnited States - Remote R1d ago
-
AI Data Infrastructure Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
AWS | Ansible | Azure | CAD Integration | CI/CDMid-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | CRUSH maps | CSI | Capacity Planning | CephRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Storage Engineer (NetApp / Pure / Ceph) USD 100K-150KAnsible | Backup | CRUSH | CSI | Capacity PlanningHealth benefits | Paid time off | Remote workSenior-level Full TimeUnited States - Remote R1d ago
-
Engineer, Data USD 101K-144KApache Spark | Automated testing | Azure Data | Azure Data Factory | Azure Data LakeAnnual Incentives | Professional development | Quarterly incentives | Remote work | Retirement benefitsMid-level Full TimeWork at Home - Ohio - … R1d ago