Data Software Engineer II - PySpark/ETL/AWS/
Jersey City, NJ, United States
USD 170K-201K (estimate) Mid-level Full Time
Tasks
- Apply data engineering best practices
- Collaborate on cross functional data initiatives
- Debug and troubleshoot data pipeline issues
- Design and develop data pipelines
- Develop secure production code
- Implement ETL processes
- Implement automation to reduce remediation
- Monitor pipelines and run data quality checks
- Optimize pipeline performance and scalability
- Perform data extraction and transformation
Perks/Benefits
- Backup childcare
- Financial coaching
- Health care coverage
- Mental health support
- On-site health and wellness centers
- Retirement savings plan
- Tuition reimbursement
Skills/Tech-stack
Airflow | Amazon Web Services | Automation | CI/CD | Continuous Delivery | Data Lake | Data Quality | Data pipeline | Databricks | ETL | PySpark | Python | SQL | Snowflake | System design | Testing | Web Services
Education
N/A
Roles
Data Engineer | Engineer | Engineer II | Software Engineer | Software Engineer II
Regions
Countries
States
Cities
Related jobs
-
Senior Data Engineer TS/SCI Clearance USD 160K-220KAWS | Cloud Native | Data Visualization | Database Design | Database performanceBest place to work recognition | Employee development | Full employee approach | High employee morale and retentionSenior-level Full TimeHuntsville, United States4h ago
-
Data Engineer USD 148K-263KAPI | Apache Kafka | Apache Spark | Cassandra | Distributed SystemsDisability insurance | Health insurance | Holiday pay | Learning and development | Life insuranceMid-level Full TimeUSA-Remote Work R4h ago
-
A/B | A/B Testing | B testing | CI/CD | Collaborative FilteringSenior-level Full TimeSan Jose, California, United States4h ago
-
Data cleaning | Data collection | Deep learning | Machine Learning | Model EvaluationSenior-level Full TimeSan Jose, California, United States4h ago
-
GenAI Engineer USD 93K-163KAWS Bedrock | Agentic Workflows | C++ | CI/CD | CohereHealth and wellness benefits | Mentorship | Professional developmentEntry-level Full TimeArlington/Rosslyn, Virginia, United States4h ago
-
Senior GenAI Engineer USD 102K-171KAPI Development | AWS Bedrock | Agentic Workflows | CI/CD | CohereSenior-level Full TimeArlington/Rosslyn, Virginia, United States4h ago
-
Data Scientist - Platform Infrastructure USD 127K-189KData Governance | Data Modeling | Data Pipelines | Data Quality | ETLMid-level Full TimeLos Angeles, California, United States4h ago
-
Computer Vision | Data Pipelines | Language Models | Language Processing | Large Language ModelsSenior-level Full TimeBellevue, WA | Menlo Park, CA5h ago
-
Senior Software Engineer, Cloud Databases USD 174K-252KAnalytical processing | Benchmarking | C++ | Cloud Databases | Cloud platformSenior-level Full TimeKirkland, WA, USA5h ago
-
SOC Architect, XProf USD 147K-211KC# | C++ | Compiler profiling | Data Analysis | Data VisualizationSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Applied Machine Learning | Backend Development | C++ | Computer Vision | Data AnalysisSenior-level Full TimeMountain View, CA, USA5h ago
-
Artificial Intelligence | Computer Vision | Computer vision models | Data Processing | Data StorageSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Data Engineer, Global Business and Operations USD 130K-187KBigQuery | Data Governance | Data Marts | Data Modeling | Data PipelinesMid-level Full TimeNew York, NY, USA5h ago
-
Sr. Machine Learning Engineer USD 91K-177KAlgorithms | Anomaly Detection | Apache Airflow | Data Analysis | Deep learning401k plan | Employee recognition | Employee stock purchase plan | Health insurance | Paid time offSenior-level Full TimeIrvine, CA, US8h ago
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | Vision insuranceSenior-level Full TimeFayetteville, North Carolina, United States15h ago
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | TS/SCI clearance | Vision insuranceSenior-level Full TimeSneads Ferry, North Carolina, United States15h ago
-
Data Engineer - Mid-Level USD 130K-160KAirflow | Automated Deployment | Automated testing | CI/CD | Control workflows401k matching | Dental insurance | Health insurance | Lunch and snacks provided | Maternity & paternity leaveMid-level Full TimeEl Segundo, California, United States15h ago
-
Software Engineer – Surgical Robot Manufacturing USD 127K-192KAutomated testing | Control Systems | HTML | JSON | JavaScriptMid-level Full TimeSunnyvale, CA, United States16h ago
-
Senior-level Full TimeRemote - United States R16h ago
-
Senior Manufacturing Analytics Engineer USD 115K-140KChemometrics | Data Preparation | Descriptive Analytics | Feature Engineering | Machine LearningComprehensive benefits | Medical benefits | Sick leave | Travel up to 15 percentSenior-level Full TimeWayzata, Minnesota, US United States, 5539116h ago
-
Senior Data Engineer - Logistics USD 38K-38KBig Data | Cloud Computing | Cloud Cost Optimization | Column-Level Security | Cost Optimization401k plan | Dental insurance | Health insurance | Life insurance | Paid time offSenior-level Full TimeSpringdale, AR Terminal Office - Springdale, …16h ago
-
Data Engineer USD 127K-170KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsCareer advancement | Flexible work environment | Professional development | Recognition | Work-life balanceSenior-level Full TimeTampa, FL, USA, United States16h ago
-
Data Reliability Engineer USD 87K-123KAWS | Alerting | Amazon DynamoDB | Amazon EMR | Amazon Kinesis401k matching | Dental insurance | Employee resource groups | Flexible work environment | Health insuranceMid-level Full TimeKS Overland Park, United States16h ago
-
Big Data | Cloud Cost Optimization | Cost Optimization | Data Architecture | Data Governance401k plan | Dental insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSpringdale, AR Terminal Office - Springdale, …16h ago
-
Senior Data Engineer (Apache Spark, NiFi, SQL) USD 140K-231KApache NiFi | Apache Spark | Hadoop | Java | Netezza401k match | Fitness reimbursement | Paid sick and safe time | Paid vacation | Tuition reimbursementSenior-level Full TimeO'Fallon, Missouri (Main Campus), United States16h ago