Lead Software Engineer - Data Engineer
Jersey City, NJ, United States
USD 170K-185K (estimate) Senior-level Full Time
Tasks
- Automate remediation of recurring issues
- Build Spark based ETL ELT pipelines
- Design and develop data engineering solutions
- Develop and debug production Python PySpark code
- Ensure data pipeline operational stability
- Evaluate vendor and startup architectures
- Implement secure coding and peer review
- Lead proof and adoption of AI assisted engineering practices
- Maintain and optimize lakehouse tables and metadata
- Optimize Spark SQL queries and execution plans
Perks/Benefits
- Backup childcare
- Financial coaching
- Health care coverage
- Mental health support
- On-site health and wellness centers
- Retirement savings plan
- Tuition reimbursement
Skills/Tech-stack
AWS | AWS Glue | AWS Glue Data Catalog | AWS S3 | Apache Iceberg | Apache Kafka | Apache Spark | Automated testing | CI/CD | Cause analysis | Compaction | Continuous Delivery | Data Catalog | Databricks | ELT | EMR | ETL | Glue Data Catalog | Iceberg | Incident Troubleshooting | Java | Kafka | Metadata Management | PySpark | Python | Root Cause Analysis | Root cause | SQL | Schema evolution | Small File Mitigation | Snapshot Retention | Spark SQL | Spark Structured Streaming | Streaming ETL | Structured Streaming | Table Partitioning | Test strategy
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Software Engineer | Software Engineer
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
Data Engineer, Senior (Oracle ERP) USD 128K-174KADFDI | Agile | Automation | CI/CD | Cloud ERP401k match | Employee assistance program | Family and caregiving support | Flexible spending accounts | Health savings accountSenior-level Full TimeColumbus, OH, US6h ago
-
Senior Product Engineer, Fullstack USD 165K-250KAPI Design | Amplitude | CI/CD | Data Modeling | GoHealth insurance | Startup equitySenior-level Full TimeSan Francisco7h ago
-
Software Engineer, Applied AI / Product USD 160K-220KAgentic AI | Data indexing | Evaluation | GraphQL | GuardrailsMid-level Full TimeSan Francisco Bay Area7h ago
-
C++ | DDS | Debugging | Hypervisor | Kernel Modules401k plan | Dental insurance | Equity programs | Green card support | Health insuranceSenior-level Full TimeMilpitas, CA7h ago
-
Machine Learning Engineer USD 120K-160KActive Learning | C++ | CI | CI Based Validation | CPU GPUHealth insurance | Professional development opportunities | Retirement plansSenior-level Full TimeHuntington Beach, CA9h ago
-
Embedded Autonomy Engineer USD 130K-220KBash | Board Support | Board Support Package | Bootloader | C#Health insurance | Professional development opportunities | Retirement planSenior-level Full TimeHuntington Beach, CA10h ago
-
Senior ML Ops Engineer (Machine Learning Infrastructure) USD 150K-250KAWS | Amazon SageMaker | Apache Airflow | Azure | CI/CDHybrid work | Onsite in Los Angeles at least 1 week per monthSenior-level Full TimeLos Angeles, CA10h ago
-
Data Governance Specialist/Lead USD 85K-136KAccess Rights | Compliance | Data Access Rights | Data Catalog | Data Dictionary401k matching | Adoption Assistance | Dental insurance | Disability insurance | Employee discountsSenior-level Full TimeWarrenville, IL, United States R11h ago
-
Availability Calculation | Building codes | Capacity Planning | Cause analysis | CommissioningMid-level Full TimeMesa, Arizona, USA11h ago
-
Product Lifecycle Electrical Engineer, Data Center Engineering - Electrical Products and Services (DCE-EPS) USD 116K-160KBuilding codes | Cause analysis | Commissioning | Construction drawings | Data Center EngineeringSenior-level Full TimeHerndon, Virginia, USA11h ago
-
Access Control | Agile | Data Governance | Data Modeling | Data SecurityFlexible core business hours | Remote workEntry-level Full TimeArlington, VA, Remote, United States R11h ago
-
Agile | Data Architecture | Data Governance | Data Integrity | Data Modeling401k | Employee assistance program | Employee discounts | Health, dental, and vision plans | Life insuranceSenior-level Full TimeArlington, VA, Remote, United States R11h ago
-
Technology Strategy Lead USD 185K-235KAI Enterprise | AI RMF | AWS Bedrock | AWS Redshift | AWS SageMakerSenior-level Full TimeIrving, US11h ago
-
Embedded Software Engineer (PL Integration & IPC) USD 130K-140KAPU | AXI | AXI interconnect | BSP Development | C plus plusMid-level Full TimePalo Alto, California, United States12h ago
-
ALSA | ASIL | Audio HAL | C# | C++Career growth opportunities | Comprehensive benefits | Mentorship | On-site workMid-level Full TimePalo Alto, California, United States12h ago
-
AMD x86 | AOSP | Android | BSP | Bring-upSenior-level Full TimePalo Alto, California, United States12h ago
-
Lead Embedded Software Engineer (Mediatek Platform) USD 140K-160KBSP | Bootloader | Bring-up | C plus plus | C#Career growth | Comprehensive benefits | MentorshipSenior-level Full TimePalo Alto, California, United States12h ago
-
Robotics Software Engineer BRL 120K-145KAutonomous Navigation | C++ | Controls systems | Embedded Systems | Hardware-in-the-loopCareer growth | Comprehensive benefits | MentorshipMid-level Full TimeNorth Reading, MA12h ago
-
Software Engineer, Data Engineering, LOKI USD 166K-220KAPIs | Algorithms | Apache Tinkerpop | BOM | C++Health benefits | On-call rotation support | Recovery BenefitsMid-level Full TimeSanta Ana, California, United States13h ago
-
Senior Robotics Engineer - Undersea Dominance USD 220K-292KAnomaly Detection | C++ | Cameras | Computer Vision | LidarSenior-level Full TimeCosta Mesa, California, United States13h ago
-
Robotics Software Engineer - Undersea Dominance USD 191K-253KAnomaly Detection | C++ | Cameras | Computer Vision | GazeboMid-level Full TimeCosta Mesa, California, United States13h ago
-
Applied AI Engineer, Advertising Agents (New Grad) USD 135K-155KAgent Orchestration | Artificial Intelligence | Asynchronous programming | Concurrent programming | Data Modeling401k matching | Commuter benefits | Dental insurance | FSA | HSAEntry-level Full TimeMountain View, California, United States13h ago
-
Machine Learning Engineer, Ops USD 125K-165KCI/CD | GPU Acceleration | Go | Inference Optimization | Inference Server401k matching | Company equity | Dental insurance | Fertility support | Health insuranceMid-level Full TimeRemote (U.S. or Europe) R13h ago
-
Staff Data Engineer USD 170K-200KAccess Controls | Airflow | Alerting | Amazon Web Services | Anomaly Detection401k employer matching | Comprehensive health benefits | Employee stock purchase program | Offsite team retreats | Parental leaveSenior-level Full TimeUS Remote R13h ago