Lead Software Engineer - Data Engineer
Jersey City, NJ, United States
USD 170K-185K (estimate) Senior-level Full Time
Tasks
- Automate remediation of recurring issues
- Build Spark based ETL ELT pipelines
- Design and develop data engineering solutions
- Develop and debug production Python PySpark code
- Ensure data pipeline operational stability
- Evaluate vendor and startup architectures
- Implement secure coding and peer review
- Lead proof and adoption of AI assisted engineering practices
- Maintain and optimize lakehouse tables and metadata
- Optimize Spark SQL queries and execution plans
Perks/Benefits
- Backup childcare
- Financial coaching
- Health care coverage
- Mental health support
- On-site health and wellness centers
- Retirement savings plan
- Tuition reimbursement
Skills/Tech-stack
AWS | AWS Glue | AWS Glue Data Catalog | AWS S3 | Apache Iceberg | Apache Kafka | Apache Spark | Automated testing | CI/CD | Cause analysis | Compaction | Continuous Delivery | Data Catalog | Databricks | ELT | EMR | ETL | Glue Data Catalog | Iceberg | Incident Troubleshooting | Java | Kafka | Metadata Management | PySpark | Python | Root Cause Analysis | Root cause | SQL | Schema evolution | Small File Mitigation | Snapshot Retention | Spark SQL | Spark Structured Streaming | Streaming ETL | Structured Streaming | Table Partitioning | Test strategy
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Software Engineer | Software Engineer
Regions
Countries
States
Cities
Related jobs
-
Low Power Design Methodology and Optimization Engineer USD 192K-278KANSYS | C# | C++ | CPU Benchmarking | CPU microarchitectureSenior-level Full TimeAustin, TX, USA3h ago
-
Senior Data Engineer, Databricks USD 119K-145KApache Spark | Asset bundles | Auto Loader | Azure Data | Azure Data Factory401k company match | Accrued vacation time off | Dental insurance | Long-term disability | Medical insuranceSenior-level Full TimeDENVER, CO, US9h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 190K-252KAnomaly Detection | Bayesian Filtering | Big Data | C# | C++Health benefits | Recovery BenefitsSenior-level Full TimeFort Collins, Colorado, United States16h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 220K-292KAdaptive filtering | Anomaly Detection | Bayesian Filtering | C# | C++Senior-level Full TimeWashington, District of Columbia, United States16h ago
-
Senior Software Engineer, Robotics Tracking and Fusion USD 220K-292KAdaptive filtering | Anomaly Detection | Bayesian Filtering | C# | C++Competitive benefits | Employee assistance program | Health insurance | Recovery BenefitsSenior-level Full TimeWaltham, Massachusetts, United States16h ago
-
Software Engineer, Robotics Tracking and Fusion USD 165K-218KAnomaly Detection | Bayesian Filtering | C# | C++ | ClassificationHealth benefits | Paid time off | Recovery Benefits | Relocation assistance | U S Top Secret clearance supportMid-level Full TimeFort Collins, Colorado, United States17h ago
-
Software Engineer, Robotics Tracking and Fusion USD 191K-253KAnomaly Detection | Bayesian Filtering | Big Data | Big Data Pipelines | C#Employee benefits | Health and Recovery Support | Health benefits | Paid time offMid-level Full TimeWashington, District of Columbia, United States17h ago
-
Software Engineer, Robotics Tracking and Fusion USD 191K-253KAnomaly Detection | Bayesian Filtering | Big Data | Big Data Pipelines | C#Employee assistance | Flexible time off | Health benefits | Recovery supportMid-level Full TimeWaltham, Massachusetts, United States17h ago
-
Lead Machine Learning Engineer USD 139K-304KAI Services | Agile | Azure AI | Azure AI Services | Azure Container401k matching | Adoption Assistance | Childcare tuition discounts | Company bonus | Fertility benefitsSenior-level Full TimeAnn Arbor, MI, United States18h ago
-
Behavior planning | C++ | Computer Vision | Control Systems | IMUEquity compensation | In-office work schedule | Relocation assistance | Visa sponsorship for transfersSenior-level Full TimeSan Francisco, California, United States1d ago
-
Agentic Workflows | Automation | Data integration | Enterprise Integration | GenAIMedical/Dental/Vision insurance | Unlimited PTO | Wellness stipendMid-level Full TimeSan Francisco, California, United States1d ago
-
Common table expressions | Compiled SQL Table Functions | DB2 SQL | Db2 Table Functions | Deterministic SQLHybrid work location flexibilitySenior-level Full TimeSeattle, Washington, United States R1d ago
-
AWS | Adversarial Machine Learning | Azure | Bias and fairness | C++401k profit sharing | Dental insurance | Education reimbursement | Employee referral incentive | Flexible spending accountsSenior-level Full TimeHuntsville, Alabama, United States1d ago
-
Consultant (LLM/AI Skillset) USD 110K-160KAPI Development | Agile | Language Models | Large Language Models | Machine LearningMid-level Full TimeDallas, Texas, United States1d ago
-
Agent systems | Enterprise Data | Fine Tuning | LLM Fine-tuning | Language ModelsRemote workSenior-level Full TimeAustin R1d ago
-
Staff Manufacturing Engineer, Robotics USD 128K-160KAssembly processes | Automation | Cause analysis | Controls engineering | DFADental and vision insurance covered | Health insurance premiums covered | Healthcare premiums for dependents supported | Paid parental leave | Paid time offSenior-level Full TimeWeirton, WV1d ago
-
Senior Data Analytics Engineer USD 175K-214KBusiness Intelligence | Dashboard Development | Data Engineering | Data Pipelines | Data QualitySenior-level Full TimeSan Francisco, CA1d ago
-
Senior-level Full TimePalo Alto, CA1d ago
-
Robotics Field Engineer USD 90K-160KAWS | Data Visualization | Electromechanical troubleshooting | Grafana | Laboratory automation401k company match | Flexible PTO | Green card sponsorship | H1B sponsorship | Medical, dental, vision plansMid-level Full TimeLos Angeles1d ago
-
Senior Software Engineer, Robotics Platform USD 160K-265KC# | C++ | CUDA | DDS | Embedded SystemsHigh ownership team | On site five days a week | Real production impactSenior-level Full TimeSan Francisco1d ago
-
Spacecraft Embedded Software Engineer, RTOS USD 131K-184KBare Metal | C++ | Computer Architecture | Computer Networking | Data Structures401k employer match | Flexible PTO | HSA matching | Medical, dental, and vision insurance | Paid HolidaysEntry-level Full TimeEl Segundo, California, United States1d ago
-
Senior Spacecraft Embedded Software Engineer, RTOS USD 169K-216KBare Metal | C++ | Computer Architecture | Computer Networking | Critical software401k match | Cell phone reimbursement | Complimentary EV charging | FSA option | Flexible PTOSenior-level Full TimeEl Segundo, California, United States1d ago
-
Algorithm Development | Data Analysis | Database Design | Debugging | Performance EngineeringAmazon Prime membership | Company events | Dental coverage | Flexible work schedule | Group life insuranceSenior-level Full TimeColumbia, MD; Aurora, CO1d ago
-
Title: Principal AI Engineer – Agentic AI | Contract to Hire | Irvine, CA (Hybrid) | AS A USD 122K-168KAWS | Agent Orchestration | Agentic AI | Embeddings | Function CallingSenior-level Full TimeIrvine, CA; Irvine, CA1d ago
-
Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract to Hire | Irvine, CA (Hybrid) | A USD 147K-170KAWS RDS | Airflow | Amazon EMR | Amazon Redshift | Amazon Web ServicesContract-to-hire | Hybrid work | Mentorship opportunitiesSenior-level Full TimeIrvine, CA R1d ago